Jump to content

Roadmap: Difference between revisions

From mediawiki.org
Content deleted Content added
No edit summary
Line 246: Line 246:
=== [[Wikimedia Features engineering|Features]] ===
=== [[Wikimedia Features engineering|Features]] ===
=== [[Wikimedia Platform Engineering|Platform]] / Dev-Ops ===
=== [[Wikimedia Platform Engineering|Platform]] / Dev-Ops ===
==== MediaWiki Core ===
==== MediaWiki Core ====
* Memcache client replacement
* Memcache client replacement
** Deploy memcache client to Apaches (RT 3155) - possibly blocked on Precise deployment to eqiad
** Deploy memcache client to Apaches (RT 3155) - possibly blocked on Precise deployment to eqiad
Line 253: Line 253:
==== Analytics ====
==== Analytics ====
==== Engineering Community Team ====
==== Engineering Community Team ====

== October 2012 and later or unscheduled ==
== October 2012 and later or unscheduled ==
=== Technical Operations ===
=== Technical Operations ===

Revision as of 09:27, 29 July 2012

Background: In recent years, Wikimedia Foundation's engineering planning has primarily taken place in a combination of internal goals documents and public project-level documentation. The purpose of this page is to establish a practice of sharing holistic engineering goals, initially primarily with a short term horizon, as a public document with open participation. See also:

  • Product Whitepaper for Wikimedia Foundation product priority justifications; Strategic Plan for long-term WMF goals, some of which are engineering goals
  • Roadmap/Archive for an earlier effort to create a roadmap more focused on point releases of the MediaWiki software

Previous months:

Item syntax:

* '''[[Project name]]'''
** [Qualifier keyword] Action item [Owner(s)] [Completion keyword]

Examples:

  • New unicorn engagement
    • [Needs consensus] Deploy unicorns [Brion/Tim]
    • Deploy unicorns [Brion/Tim] [DONE]

Continuous Responsibilities

  • Code review
  • RT review / ops tasks
  • Community extension review and deployment
  • Bug triages and general bug fixes
  • New extension deployment (Review queue)
  • Labs maintenance
  • Test infrastructure maintenance
  • Recruitment and encouragement of volunteers

July 2012

Tech Ops

  • Swift
    • Swift replaces ms5@tampa as primary storage [Ben/Mark] - WIP
    • Seeding Swift with contents in Commons @ tampa - progress [Aaron/Ben] - WIP
    • Test new multi-write file backend in production (precondition for enabling both NFS and Swift backends) [Aaron/Ben]
  • Fundraising infrastructure buildup@ EQIAD
    • deploy Firewall - WIP
    • deploy payment clusters
  • Deploy Memcached @TAMPA [Mark/Asher] - move to Aug
  • Limited Apache-on-Precise deployment [Asher/Peter/Mark] - WIP
  • Deploy new parser cache (pc1) @ Tampa [Asher] - done
  • Varnish
    • incorporate persistent store and test [Mark] - in progress
    • deploy Varnish with persistent store [Mark]
  • labs
    • deploy 3 more project nodes [Ryan] - done
    • migrate lab projects using GlusterFS to local filesystem - in progress
    • evaluate Ceph as an option to replace GlusterFS - in progress; initial test results not encouraging
  • Create new Gerrit database @ Eqiad and make it primary DB [Asher/Ryan] - Done
  • Release alpha2/3 of WLM app [DONE]
  • Release beta1 of WLM app
  • Release dark chrome version of Nav Menu to Beta [DONE]
  • Migrate WLM TS API to WMF
  • Begin work with Praekelt on Vumi [DONE]
  • Release alpha of J2ME app with OpenPath [DONE]
  • VisualEditor
  • New Pages Feed (fka Page Triage)
    • Continue developing curation toolbar features: Deletion Tagging, WikiLove
    • Public launch of curation toolbar feature: [Week of July 30]
    • Other potential changes to be prioritized (e.g., message to article author, visual changes to New Pages Feed, etc.) [Scope to be finalized week of July 23]
    • Increase visibility of Special:NewPagesFeed (e.g., notice on Special:NewPages)
    • Additional socialization
  • Article feedback
    • Increase AFTv5 coverage on English Wikipeida (timetable still in flux, but will start week of July 2)
    • Increased to 5% [DONE]
    • Continued to deployment to 10% expected [DONE]
    • Central notice to registered users [DONE]
    • Refactor AFTv5, bugfixing, i18n, browser support [IN PROCESS]
  • Echo_(Notifications) & Flow
    • Begin development of prototype for Mediawiki.org [Werdna/Vibha] [IN PROCESS]
    • see Performance engineering for prep work on Flow
  • ResourceLoader 2 -- mostly the Gadgets-extension work which is (as of June 2012) in a branch.
    • Set up a first working setup in WMF labs [Roan, Timo] [IN PROCESS]
    • "Gadgets 3.0": Includes getting a version deployed/integrated, then a review of Salvatore's "Gadgets user preferences" work, then a merge of Salvatore's work
  • TimedMediaHandler
    • Working TMH implementation in Labs (Jan/Antoine) [IN PROCESS]
    • Establish transcoding infrastructure (Jan) [IN PROCESS]
    • Working TMH implementation in Labs (Jan/Antoine) [IN PROCESS]
  • Fundraising Engineering]
    • Onboarding new people [DONE]
    • Kickoff for new fiscal year [DONE]
    • Auditing and Reconciliation (expect to complete mid-late August) [IN PROCESS]

Internationalization & Experimentation

  • E3
    • E3 Analytics Server provisioned [DONE]
    • Post-edit Feedback [IN PROGRESS]
      • Bucketing system test initiated [RESULTS PENDING]
      • Testing of Bucketing system [DONE]
      • UI for post-edit feedback experiment Dry Run on testwiki (pending successful test of bucketing system) [IN PROGRESS]
      • Post-edit feedback experiment live on en.wp [IN PROGRESS]
    • Enabling clicktracking on Community Portal page on en.wp [IN PROGRESS]
  • Internationalization/Localization

Platform / Dev-Ops

MediaWiki Core

  • Lua scripting
    • Debugging tools [DONE]
    • Beef up the labs instance [DONE]
    • Spam cleanup on labs site [ongoing] (TheDJ has been very helpful here)
    • Documentation [ongoing]
  • MediaWiki 1.20/Roadmap
    • Bi-weekly deployment cycle continues
      • Complete 1.20wmf6 deployment [DONE]
      • Complete 1.20wmf7 deployment [DONE]
      • Deploy 1.20wmf8 through to enwiki (ongoing)
  • Continuous integration
    • (work on hold while Beta Labs work proceeds)
  • Git/Conversion [Chad/Antoine]
    • Gerrit evaluation - Revisit Gerrit, git-review, and other code review/workflow tools (3 months after the git switch) to see whether to switch to Phabricator or another code review tool [Brion, David, Chad] (ongoing)
    • Gerrit 2.4 upgrade [Chad/Ryan]
  • Memcache client replacement [Tim Starling]
  • SwiftMedia
    • See "Swift" in Ops section
  • OAuth
    • Work postponed (see August)
  • CentralAuth
    • Bugfixing [Chris Steipp] [ongoing]
  • AbuseFilter
    • Bugfixing [Chris Steipp] [ongoing]
  • Site performance

Engineering Community Team

  • Bug Wrangling [Bug Wrangler + volunteer Krenair + other volunteers]
  • Monthly report and other engineering communications [Guillaume]
  • Google Summer of Code mentoring & administration [Sumana + volunteer Greg Varnum]
  • Preparing for future events [Sumana]

QA

  • Continuing feature testing work [Chris]
    • AFTv5 testing (onging)
    • Explore the possibilty of contributing testing to E2
  • Beta cluster & Labs improvements [Chris]
    • Get AFTv5 code on beta labs as example and for testing

August 2012

Technical Operations

  • Deploy Memcached @TAMPA [Mark/Asher]
  • Swift
    • Move to new 404 handler (Aaron/Ben) (August)
    • Cutover Originals (multi-media) on Swift - Tampa [Aaron/Ben] (August)
      • Initial testing stage with NFS as backup (August)
      • Full switch-over (disable NFS) (August)
    • upgrade Swift to 1.5 from 1.43 [Ben] (August)
    • build up Eqiad Swift and start replication [RobH / Ben] (August)
  • Fundraising infrastructure buildup@ EQIAD
    • deploy MQ server
    • deploy applications
  • Limited Apache-on-Precise deployment @ Tampa [Asher/Peter/Mark]
  • Varnish
    • deploy Varnish with persistent store [Mark]
    • deploy Varnish with fixes to streaming video performance issues [Mark]
  • Release next WLM relase
  • release next Nav release
  • Evaluate additional features
    • Mobile Article Feedback feature definition [Phil]
    • Minor Editing [Phil]

Platform / Dev-Ops

MediaWiki Core

QA

    • Engage E2 team for potentially useful testing\
    • Enable and configure useful extensions on beta labs for testing

Analytics

Engineering Community Team

  • Bug Wrangling [Bug Wrangler + volunteers]
  • Monthly report and other engineering communications [Guillaume]
  • Google Summer of Code wrapup [Sumana]
  • Planning events [Engineering Outreach Coordinator]
  • UCOSP planning [Sumana]

September 2012

Technical Operations

  • Install new passive optics system between the 2 datacenters in Tampa
    • CWDM Optics to increase bandwith capacity [Leslie]
  • Install new MX80 @ Evoswitch [mark]
  • Wide Apache-on-Precise test deployment @ Tampa [Asher/Peter/Mark]
  • Limited ImageScalers-on-Precise deployment @ Tampa [Asher/Peter/Mark]
  • Swift
    • Complete Eqiad Swift replication [RobH / Ben]

Platform / Dev-Ops

MediaWiki Core

  • Memcache client replacement
    • Deploy memcache client to Apaches (RT 3155) - possibly blocked on Precise deployment to eqiad
    • Configuration change (to be scheduled)

QA

Analytics

Engineering Community Team

October 2012 and later or unscheduled

Technical Operations

  • Deploy Memcached @EQIAD [Mark/Asher]
  • Deploy Etherpad Lite [Daniel/RobH]
  • Deploy Mingle [RobH/DZ]
  • New Pages Feed (fka Page Triage)
    • Additional feature development (only must-haves)
  • Article Creation Workflow
    • revisit for release
    • Changes to visual design to make ACW consistent with Design Toolkit
  • Echo_(Notifications)
    • Continued development of prototype for Mediawiki.org [Werdna/Vibha]

Platform / Dev-Ops

Engineering Community Team

  • India hackathon in the fall? [Sumana, Engineering Outreach Coordinator]
  • UCOSP maintenance
  • Community testing events

Parking lot and todos