Jump to content

Roadmap/2012/October

From mediawiki.org
The printable version is no longer supported and may have rendering errors. Please update your browser bookmarks and please use the default browser print function instead.

October 2012

Technical Operations

  • Redis/Memcached
    • Deploy limited php-redis on the apaches, and all new sessions are being written to a redis instance (mc1). [Tim/Asher] [Done]
  • Swift
    • start migrating swift backend servers to new NAS1 server [Mark] [done]
    • Evaluate Ceph [Faidon/Asher/Aaron] [on-going]
  • Commons infrastructure
    • migrate ms7 (commons) to Nas1 [Done]
    • replicate Nas1 (Tampa) to Nas2 (Ashburn) [done]
  • Parser Cache
    • build 2 more parser cache instances@ Tampa [Mark] [Done]
  • Deploy Varnish on upload@Eqiad to replace squid [Mark] {done]
  • Deploy 4 new servers for bits@ESAM [Mark] [done]
  • Deploy Wikidata
  • VisualEditor/Parsoid (Trevor, Roan, Rob, Gabriel, Subbu, MarkTraceur, + Wikia)
    • API finalization/debugging [IN PROCESS]
    • Iteration on Visual Editor for Dec release [IN PROCESS]
    • Parsoid testing framework for semantic/superficial regressions [IN MAINTENANCE]
    • Node.js parsoid to completion [ONGOING, 75% exact, 93% semantic]
    • experimentation into C/C++ version [ON HOLD UNTIL JAN]
  • New Pages Feed (fka Page Triage) (Kaldari, Benny)
    • Additional socialization and public announcement/launch [DONE]
    • Descriptive statistics on NPF (revised dashboard on toolserver) [Dario] [IN PROCESS]
    • Bug fixes (no more feature development) [ONGOING]
  • Echo (Notifications) and Flow (Kaldari, Benny, Werdna, Luke Welling, Preilly, Aaron S)
    • re-deployment of Echo prototype for Mediawiki.org [Werdna/Vibha/Kaldari] [NOV 1]
    • issue with relative timestamping (WSTimestamp::GetHumanTimestamp and Language::prettyTimestamp patch) [IN PROCESS]
    • Continued development of Echo prototype for Mediawiki.org [Werdna/Vibha/Kaldari/Benny] [ONGOING]
    • Selection of initial use cases [Vibha/Fabrice] [DONE]
    • UI and bugfixing of Echo [Krenair] [ONGOING]
    • Global user changes [JamesF] [IN PROCESS]
    • (see Performance engineering for infrastructure prep work:)
  • Article feedback (Matthias)
    • (most delayed because of Wikivoyage resourcing)
    • Oversight checklist (to help reduce the volume of oversight requests) [DONE]
    • Continued AbuseFilter work [DONE]
    • Conversion analysis: [DONE]
    • performance/db related changes to AFTv5 queries before scaling, + sharding (see Database sharding) [Matthias] [IN PROCESS]
  • E3 (Ori, S, Luke)
    • Clicktracking/Analytics
      • Event tracking live [DONE]
      • EventTracking schema filtering [IN PROCESS]
      • Clicktracking sunset [Scheduled for 10/31]
      • Funnel tracking of Community Portal [Started] (will be ongoing)
    • Account Creation User Experience
      • Deployment of first test to production [DONE]
      • Deployment of second test to production (client-side validation) [10/24]
      • Minor UI tweaks [IN PROCESS]
      • Data analysis once experiment is complete [IN PROCESS]

Fundraising

  • Data discrepency error/regressions [IN PROCESS]

Multimedia

  • Beta features
    • left nav [DONE]
    • new typography [DONE]
    • login [DONE]
  • Prod
    • left nav [DONE]
    • new typography [DONE]
  • promote wikipedia beta app to stable [DONE]
  • mobile friendly resource loader [DONE]
  • dynamic sections [DONE]
  • pickup any remaining redirects [office, chapters, ...] [DONE]
  • Launch Saudi [DONE]

QA

  • Created basic Regression Tests Mobile Browser Regression Tests
  • Start Implementing Watir-based browser Mobile Testing Watir-webdriver Mobile Testing
  • Continue working with Chris and Zeljko to use CI framework that the Platform QA team is setting up
  • Continue to work with the Product team to Test prior to each deployment

Platform / Dev-Ops

MediaWiki Core

QA

  • Beta labs
    • Continue refining beta labs performance [Antoine/Chris/Željko] [ONGOING]
  • Begin work on Watir-based browser testing framework
    • Create at least one useful end-to-end test for important Wikipedia feature, with automatic execution (Jenkins-driven) and results reporting [Chris/Željko]
    • Create a list of targets for browser testing according to priority
  • Continue integrating Mobile QA with overall QA/testing activities

Analytics

See also: Analytics/Roadmap

Kraken
  • Set up Maven / Somatype Artifact Repository (continuous integration) [dsc]
    • WMF Maven parent pom [dsc]
  • Puppetize Kraken [otto] (Ongoing)
  • Set up JMX monitoring -- needs to be our LAN [otto + dsc]
    • Hadoop Ganglia Monitoring [otto] (Oct) [DONE]
  • Get Storm set up [dsc + otto]
    • Start work on ETL topology [dsc]
  • Hardware reinstallation -- Depends on Ops [otto]
  • Get to consensus with Ops regarding logging of the firehose [dsc + otto] [DONE]
    • Research needed: test running cli JVM producers does not cause extra load [otto] [not doing]
Limn
  • Refactor charting to use d3 [dan + dsc]
    • Feature Parity with Dygraphs (plus bugfixes, etc) (Oct)
  • Bugfixes (like Save-As, UI Error Notifications, ...) [dan] (Oct)
  • Improve Limn wiki, docs, & guides (esp those shameful screenshots) [dan] (Oct)
  • UI support for remote datasets via proxy [dsc + dan] (Oct)
  • Deploy reportcard / gerrit-stats on stat1001 (aka, "the Debian packaging discussion") [otto + dsc]
  • Support the Global Dev dashboard [evan] (Ongoing)
  • Support the Gerrit Stats dashboard [diederik] (Ongoing)
Legacy Log Collection
  • Add support for new domain names in webstatscollector (blog, etc) [diederik]
  • udp2log filters
    • Update filters for Wikipedia Zero [otto] (Ongoing)
    • Filter by X-Carrier headers. [otto + asher + diederik]
    • udp-filter to filter by http status. [otto]
WikiStats
  • Reduce backlog regarding Wikistats traffic (squid etc) scripts [stefan]
  • Repair data errors in wikistats, and add process for checking data integrity [ezachte] (Sept)
  • Make wikistats more robust (MoM validations) [ezachte]
  • Add Blackbox testing to WikiStats [diederik + ezachte]
Infrastructure
  • Access/support requests for stat1, stat1001 [otto] (Ongoing)
  • Migrate Reportcard off Labs onto stat1001 -- reportcard.wikimedia.org [otto + dsc] (Oct)
  • Maintenance of oxygen/emery/locke [otto] (Ongoing)
Data Releases
  • Publish Monthly Report Card -- deal with monthly data processing irregularities, perform correction/validation [ezachte + diederik + dsc] (Ongoing)
  • Create Data Release Practices Task Force [diederik]
  • Start pushing datasets to AWS [diederik]
  • Finalize scripts to massively compact dammit.lt data [erik]
    • Blogpost about what awesome stuff you can do with this [diederik + ?]


Engineering Community Team

  • Bug Wrangling [Andre + volunteers] -- ongoing
    • Updating BZ maintenance documentation [Andre] -- in progress
  • Followup from events [Sumana] -- ongoing
    • Followup on Grace Hopper
  • Tech Ambassadors Network [Guillaume] -- ongoing on meta
    • Volunteer product management program [Guillaume] -- being integrated into Tech/Ambassadors
  • Misc Engineering community proposals
    • 20% time [Sumana] -- ongoing - target 16 Nov - moved to November
    • CoC [Sumana] -- in process
  • Internationalization/Localization
    • Universal Language Selector
      • Version 1 development [IN PROGRESS]
      • User Experience / UI testing [ONGOING]
      • Technical documentation [IN PROGRESS]
    • Project Lassi: Translate UI/UX Improvements
      • User Experience / UI testing Round 1 [DONE]
      • UI design finalization for development [IN PROGRESS]
      • Prototype development [IN PROGRESS]
    • Translate API
      • API definition [On Hold]
    • Central Notice-Translate integration
      • Code changes DONE
      • Code review/testing: The i18n team has put this integration project on hold until availability from fundraising engineers to complete code review for deployment. ON HOLD
      • Deployment - scheduled for next sprint SCHEDULED
    • Web Fonts
      • Adding languages [ONGOING]
    • Narayam
      • Adding input methods for other languages [ONGOING]
    • Project Milkshake
      • Design specification, API specification, Documentation [ONGOING]
      • jQuery.i18n Development [IN PROGRESS]
      • jQuery.uls Development [IN PROGRESS]
      • jQuery.ime Development [IN PROGRESS]
      • jQuery.webfonts Development [IN PROGRESS]
      • Technical documentation [DONE]
    • Language search
      • Initial analysis [DONE]
      • Prototype initial concept [IN PROGRESS]
      • Integration into ULS [IN PROGRESS]
    • Standards participation
      • Comments on ARB Specification [DONE]
    • Language Summit
      • Preparation for November 6-7 Language Summit [IN PROGRESS]
    • Language Team Community Meetup
      • Language Team Pune Meetup Nov 4 [IN PROGRESS]
      • Language Team Bangalore Meetup Nov 9 [IN PROGRESS]
    • India DevCamp
      • Preparation of Topics for DevCamp [IN PROGRESS]
      • Registration now open [IN PROGRESS]