Roadmap: Difference between revisions
Appearance
Content deleted Content added
No edit summary |
→= MediaWiki Core: typo |
||
| Line 246: | Line 246: | ||
=== [[Wikimedia Features engineering|Features]] === |
=== [[Wikimedia Features engineering|Features]] === |
||
=== [[Wikimedia Platform Engineering|Platform]] / Dev-Ops === |
=== [[Wikimedia Platform Engineering|Platform]] / Dev-Ops === |
||
==== MediaWiki Core === |
==== MediaWiki Core ==== |
||
* Memcache client replacement |
* Memcache client replacement |
||
** Deploy memcache client to Apaches (RT 3155) - possibly blocked on Precise deployment to eqiad |
** Deploy memcache client to Apaches (RT 3155) - possibly blocked on Precise deployment to eqiad |
||
| Line 253: | Line 253: | ||
==== Analytics ==== |
==== Analytics ==== |
||
==== Engineering Community Team ==== |
==== Engineering Community Team ==== |
||
== October 2012 and later or unscheduled == |
== October 2012 and later or unscheduled == |
||
=== Technical Operations === |
=== Technical Operations === |
||
Revision as of 09:27, 29 July 2012
Team hubs:
Background: In recent years, Wikimedia Foundation's engineering planning has primarily taken place in a combination of internal goals documents and public project-level documentation. The purpose of this page is to establish a practice of sharing holistic engineering goals, initially primarily with a short term horizon, as a public document with open participation. See also:
- Product Whitepaper for Wikimedia Foundation product priority justifications; Strategic Plan for long-term WMF goals, some of which are engineering goals
- Roadmap/Archive for an earlier effort to create a roadmap more focused on point releases of the MediaWiki software
Previous months:
- /2011/September
- /2011/October
- /2011/November
- /2011/December
- /2012/January
- /2012/February
- /2012/March
- /2012/April
- /2012/May
- /2012/June
Item syntax:
* '''[[Project name]]''' ** [Qualifier keyword] Action item [Owner(s)] [Completion keyword]
Examples:
- New unicorn engagement
- [Needs consensus] Deploy unicorns [Brion/Tim]
- Deploy unicorns [Brion/Tim] [DONE]
Continuous Responsibilities
- Code review
- RT review / ops tasks
- Community extension review and deployment
- Bug triages and general bug fixes
- New extension deployment (Review queue)
- Labs maintenance
- Test infrastructure maintenance
- Recruitment and encouragement of volunteers
July 2012
Tech Ops
- Swift
- Swift replaces ms5@tampa as primary storage [Ben/Mark] - WIP
- Seeding Swift with contents in Commons @ tampa - progress [Aaron/Ben] - WIP
- Test new multi-write file backend in production (precondition for enabling both NFS and Swift backends) [Aaron/Ben]
- Fundraising infrastructure buildup@ EQIAD
- deploy Firewall - WIP
- deploy payment clusters
- Deploy Memcached @TAMPA [Mark/Asher] - move to Aug
- Limited Apache-on-Precise deployment [Asher/Peter/Mark] - WIP
- Deploy new parser cache (pc1) @ Tampa [Asher] - done
- Varnish
- incorporate persistent store and test [Mark] - in progress
- deploy Varnish with persistent store [Mark]
- labs
- deploy 3 more project nodes [Ryan] - done
- migrate lab projects using GlusterFS to local filesystem - in progress
- evaluate Ceph as an option to replace GlusterFS - in progress; initial test results not encouraging
- Create new Gerrit database @ Eqiad and make it primary DB [Asher/Ryan] - Done
- Release alpha2/3 of WLM app [DONE]
- Release beta1 of WLM app
- Release dark chrome version of Nav Menu to Beta [DONE]
- Migrate WLM TS API to WMF
- Begin work with Praekelt on Vumi [DONE]
- Release alpha of J2ME app with OpenPath [DONE]
- VisualEditor
- planning for 1Q [DONE]
- Support for aliennodes and the like [DONE]
- API (implementation of 3 features)
- Parsoid fixes for release (December date) [ONGOING]
- New Pages Feed (fka Page Triage)
- Continue developing curation toolbar features: Deletion Tagging, WikiLove
- Public launch of curation toolbar feature: [Week of July 30]
- Other potential changes to be prioritized (e.g., message to article author, visual changes to New Pages Feed, etc.) [Scope to be finalized week of July 23]
- Increase visibility of Special:NewPagesFeed (e.g., notice on Special:NewPages)
- Additional socialization
- Article feedback
- Increase AFTv5 coverage on English Wikipeida (timetable still in flux, but will start week of July 2)
- Increased to 5% [DONE]
- Continued to deployment to 10% expected [DONE]
- Central notice to registered users [DONE]
- Refactor AFTv5, bugfixing, i18n, browser support [IN PROCESS]
- Echo_(Notifications) & Flow
- Begin development of prototype for Mediawiki.org [Werdna/Vibha] [IN PROCESS]
- see Performance engineering for prep work on Flow
- ResourceLoader 2 -- mostly the Gadgets-extension work which is (as of June 2012) in a branch.
- Set up a first working setup in WMF labs [Roan, Timo] [IN PROCESS]
- "Gadgets 3.0": Includes getting a version deployed/integrated, then a review of Salvatore's "Gadgets user preferences" work, then a merge of Salvatore's work
- TimedMediaHandler
- Working TMH implementation in Labs (Jan/Antoine) [IN PROCESS]
- Establish transcoding infrastructure (Jan) [IN PROCESS]
- Working TMH implementation in Labs (Jan/Antoine) [IN PROCESS]
- Fundraising Engineering]
- Onboarding new people [DONE]
- Kickoff for new fiscal year [DONE]
- Auditing and Reconciliation (expect to complete mid-late August) [IN PROCESS]
Internationalization & Experimentation
- E3
- E3 Analytics Server provisioned [DONE]
- Post-edit Feedback [IN PROGRESS]
- Bucketing system test initiated [RESULTS PENDING]
- Testing of Bucketing system [DONE]
- UI for post-edit feedback experiment Dry Run on testwiki (pending successful test of bucketing system) [IN PROGRESS]
- Post-edit feedback experiment live on en.wp [IN PROGRESS]
- Enabling clicktracking on Community Portal page on en.wp [IN PROGRESS]
- Internationalization/Localization
- ULS
- Prototype [IN PROGRESS]
- User Experience / UI testing [IN PROGRESS]
- Translate UX
- Prototype [IN PROGRESS]
- Translate API
- API development [IN PROGRESS]
- Translate Notifications
- Notifications DONE
- Web Fonts
- Adding languages [ONGOING]
- Enabled on Bengali Wikisource [DONE]
- Narayam
- Adding input methods for other languages [ONGOING]
- Project Milkshake
- Design specification [IN PROGRESS]
- Language search
- Analysis [IN PROGRESS]
- Prototype initial concept [IN PROGRESS]
- Integration into ULS [IN PROGRESS]
- ULS
Platform / Dev-Ops
MediaWiki Core
- Lua scripting
- Debugging tools [DONE]
- Beef up the labs instance [DONE]
- Spam cleanup on labs site [ongoing] (TheDJ has been very helpful here)
- Documentation [ongoing]
- MediaWiki 1.20/Roadmap
- Bi-weekly deployment cycle continues
- Complete 1.20wmf6 deployment [DONE]
- Complete 1.20wmf7 deployment [DONE]
- Deploy 1.20wmf8 through to enwiki (ongoing)
- Bi-weekly deployment cycle continues
- Continuous integration
- (work on hold while Beta Labs work proceeds)
- Git/Conversion [Chad/Antoine]
- Gerrit evaluation - Revisit Gerrit, git-review, and other code review/workflow tools (3 months after the git switch) to see whether to switch to Phabricator or another code review tool [Brion, David, Chad] (ongoing)
- Gerrit 2.4 upgrade [Chad/Ryan]
- Memcache client replacement [Tim Starling]
- SwiftMedia
- See "Swift" in Ops section
- OAuth
- Work postponed (see August)
- CentralAuth
- Bugfixing [Chris Steipp] [ongoing]
- AbuseFilter
- Bugfixing [Chris Steipp] [ongoing]
- Site performance
Engineering Community Team
- Bug Wrangling [Bug Wrangler + volunteer Krenair + other volunteers]
- Monthly report and other engineering communications [Guillaume]
- Google Summer of Code mentoring & administration [Sumana + volunteer Greg Varnum]
- Preparing for future events [Sumana]
QA
- Continuing feature testing work [Chris]
- AFTv5 testing (onging)
- Explore the possibilty of contributing testing to E2
- Beta cluster & Labs improvements [Chris]
- Get AFTv5 code on beta labs as example and for testing
August 2012
Technical Operations
- Deploy Memcached @TAMPA [Mark/Asher]
- Swift
- Move to new 404 handler (Aaron/Ben) (August)
- Cutover Originals (multi-media) on Swift - Tampa [Aaron/Ben] (August)
- Initial testing stage with NFS as backup (August)
- Full switch-over (disable NFS) (August)
- upgrade Swift to 1.5 from 1.43 [Ben] (August)
- build up Eqiad Swift and start replication [RobH / Ben] (August)
- Fundraising infrastructure buildup@ EQIAD
- deploy MQ server
- deploy applications
- Limited Apache-on-Precise deployment @ Tampa [Asher/Peter/Mark]
- Varnish
- deploy Varnish with persistent store [Mark]
- deploy Varnish with fixes to streaming video performance issues [Mark]
- Release next WLM relase
- release next Nav release
- Evaluate additional features
- Mobile Article Feedback feature definition [Phil]
- Minor Editing [Phil]
- VisualEditor
- New Pages Feed (fka Page Triage)
- Article feedback
- Other issues for enwp release: mobile?
- AFTv5 scalability/performance changes for enwp release [DONE]
- Echo_(Notifications) & Flow
- ResourceLoader 2 -- mostly the Gadgets-extension work which is (as of June 2012) in a branch.
- Set up a first working setup in WMF labs [Roan, Timo]
- Testing existing gadgets on WMF labs for breakage [Timo]
- "Gadgets 3.0": Includes getting a version deployed/integrated, then a review of Salvatore's "Gadgets user preferences" work, then a merge of Salvatore's work
- TimedMediaHandler
- Fundraising Engineering]
- Auditing and Reconciliation [IN PROCESS]
Platform / Dev-Ops
MediaWiki Core
- Lua scripting
- Deploy to test2
- Deploy to mediawiki.org (possibly September)
- MediaWiki 1.20/Roadmap
- Bi-weekly deployment cycle continues
- Continuous integration
- Git/Conversion [Chad/Antoine/Sumana]
- Finalize decision on Gerrit vs other tools [Brion, David, Chad]
- Replicated session handling [Tim Starling]
- SwiftMedia
- See "Swift" section in Ops
- OAuth
- Finalize specifications, identify/recruit developers [ChrisS]
- CentralAuth
- Bugfixing [Chris Steipp] [ongoing]
- AbuseFilter
- Bugfixing [Chris Steipp] [ongoing]
- Site performance
- Database sharding
- Initial prototype work (Aaron/Asher/Matthias)
- Category collation: https://gerrit.wikimedia.org/r/#/c/3367/ & bug 35632
- Possibly waiting on Liangent for more work for full deployment
- Pt wiki fix ready for deployment by Tim bug 35632
QA
- Engage E2 team for potentially useful testing\
- Enable and configure useful extensions on beta labs for testing
Analytics
Engineering Community Team
- Bug Wrangling [Bug Wrangler + volunteers]
- Monthly report and other engineering communications [Guillaume]
- Google Summer of Code wrapup [Sumana]
- Planning events [Engineering Outreach Coordinator]
- UCOSP planning [Sumana]
September 2012
Technical Operations
- Install new passive optics system between the 2 datacenters in Tampa
- CWDM Optics to increase bandwith capacity [Leslie]
- Install new MX80 @ Evoswitch [mark]
- Wide Apache-on-Precise test deployment @ Tampa [Asher/Peter/Mark]
- Limited ImageScalers-on-Precise deployment @ Tampa [Asher/Peter/Mark]
- Swift
- Complete Eqiad Swift replication [RobH / Ben]
Platform / Dev-Ops
MediaWiki Core
- Memcache client replacement
- Deploy memcache client to Apaches (RT 3155) - possibly blocked on Precise deployment to eqiad
- Configuration change (to be scheduled)
QA
Analytics
Engineering Community Team
October 2012 and later or unscheduled
Technical Operations
- Deploy Memcached @EQIAD [Mark/Asher]
- Deploy Etherpad Lite [Daniel/RobH]
- Deploy Mingle [RobH/DZ]
- New Pages Feed (fka Page Triage)
- Additional feature development (only must-haves)
- Article Creation Workflow
- revisit for release
- Changes to visual design to make ACW consistent with Design Toolkit
- Echo_(Notifications)
- Continued development of prototype for Mediawiki.org [Werdna/Vibha]
Platform / Dev-Ops
Engineering Community Team
- India hackathon in the fall? [Sumana, Engineering Outreach Coordinator]
- UCOSP maintenance
- Community testing events
Parking lot and todos
- Configuration management overhaul [Chad]
- Evaluate WikiFactory from Wikia
- Extension management -- depends on config mgmt revamp
- Details of git migration (extension mgmt, permissions, code review tool, Gerrit-Jenkins integration, etc.)
- More work on product backlogs for features and mobile
- Ops section
- Fundraising flesh-out
- cf Wikimedia Platform Engineering and merge as appropriate
- Namespace hacks for development of simple language wikipedias in languages other than English without server, database, or major wiki installation provisioning
- Most popular related articles
- Replicated session handling
- HipHop deployment (deferred because Facebook has a different shiny new thing)
- Extension:Configure (merge with config management?)
- Unicode normalization considerations
- Schema handling improvements (Abstracted database schema description, schema updaters to make the multiple schema variants for MySQL 4.0 and 5/UTF-8 more maintainable)
- Parallelizable, restartable dump runner (notes; Clean up the currently fragile externaldump process, make our internal backups more reliable
- OAI cleanup (Clean up OAI exporter and importer, add time-delay features
- audit users of OAIPMH and check how search indexing uses it
- Deletion queue system (notes; Human-helpful process improvements
- Integrated heuristic checks, improved patrolling (human-helpful process improvements)
- On-wiki namespace manager (Special:Namespaces) (original wikidata branch specs and see notes)
- Wikidata (WMDE)
- BlameMaps (WMDE)
- graphical UI on top of improved backend for configuration management
- Various HTTPS support fixes
- Wikimedia server error page
- Wikimedia operations history and architecture document
- Disk-backed object cache
- DB sharding
- Help features
- Mentoring features
- Other real-time features, chat
- Affiliation tools for WikiProjects [build on GlobalProfile]
- Gadgets 2.0?
- Interwiki transclusion
- WMF cannot commit the time to merge this.
- Replicated session handling [Tim Starling]