View source for Wikicite/grant/Improving Wikidata-Wikisource Integration/Report

==Goals==
''Did you meet your goals? Are you happy with how the project went?''


While we didn’t have specific tools or modules to be developed in the original proposal, we believe that we have been successful in making progress in the space of improving integration between Wikidata and Wikisource, which falls well within the WikiCite by leveraging the use of linked bibliographic data. The overall progress made not only includes technical interventions, but also conversations and realizing opportunities for further work in this area.

==Outcome==
''Please report on your original project targets.''

{{Project/Rapid/Report/Table/Header1}}
<!---Please use the below table to:
1. List each of your original targets from your project plan.
2. List the actual outcome that was achieved.
3. Explain how your outcome compares with the original target.  Did you reach your targets?  Why or why not? --->

<!--2 rows for your table have been provided below.  To add more rows for additional goals, just copy and paste another row template below these-->
{{PEG/Proposals/Reports/Final/Table/1/Row
| target outcome =
* Technical interventions
| achieved outcome =
* MediaWiki modules: To display metadata from Wikidata on Wikisource index pages
----
* Bot: To add Wikidata QIDs to index pages and populating [[:d:Property:P1957|P1957]] on Wikidata.
| explanation =
;Modules
*[https://en.wikisource.beta.wmflabs.org/wiki/MediaWiki:Proofreadpage_index_data_config MediaWiki:Proofreadpage index data config]: Data configuration presentation for index pages.
*[https://en.wikisource.beta.wmflabs.org/wiki/MediaWiki:Proofreadpage_index_template MediaWiki:Proofreadpage index template]: Interface text for index pages.
*[https://en.wikisource.beta.wmflabs.org/wiki/Module:Index_data Module:Index data]: To retrieve data from Wikidata.
*[https://en.wikisource.beta.wmflabs.org/wiki/Module:Index_template Module:Index template]: To display the retrieved data on the index page form.
:<small>''A significant part of the modules was written by [[User:Tpt|Tpt]] from French Wikisource, and further improvements made by [[User:Bodhisattwa|Bodhisattwa]] from Bengali Wikisource, and [[User:Tshrinivasan|Tshrinivasan]] as part of the WikiCite Project Grant.''</small>
----
;Bot
*[[User:WD-WS Integration Bot]] ([https://github.com/tshrinivasan/wikisource_wikidata_integration/tree/main/bot source code]): While the above modules retrieve data from Wikidata and display it on the index pages, they work only after the respective Wikidata QIDs are added to the index page form, which has to be done manually. The bot helps to automate the process of adding Wikidata QIDs to the index pages, to an extent. There is already a practice of linking the main page of a book to their respective Wikidata items on all Wikisources. With the help of the index page, the bot traces the main pages of books and then their linked Wikidata items, and adds them back to the Wikidata QID field on the index page form, which works with the above-mentioned modules. Subsequently, the bot also adds [[:d:Property:P1957|P1957]] to respective Wikidata items. We will continue improving the bot's workflow based on community feedback.
:<small>''The bot has been programmed by [[User:Tshrinivasan|Tshrinivasan]], as part of the WikiCite Project Grant.''</small>
}}

{{PEG/Proposals/Reports/Final/Table/1/Row
| target outcome = Technical documentation
| achieved outcome = [[:mw:Wikidata - Wikisource Integration Modules]]
| explanation = * Detailed documentation on deploying the modules and get the bot running on a Wikisource has been written. The documentation will be updated to reflect any functional improvements made to the modules or the bot. Furthermore, support will be provided to any interested Wikisource communities, to deploy the modules.
* The documentation can be intimidating for non-tech folks, so a [[:File:Wikidata - Wikisource Integration Modules Documentation Overview, June 2021.webm|screencast recording]] has been created to understand how to best use the documentation. 
}}
{{PEG/Proposals/Reports/Final/Table/1/Row
| target outcome = Community outreach
| achieved outcome = *Three communities supported for deploying the modules.
*https://diff.wikimedia.org/2021/06/30/improving-wikidata-wikisource-integration-2021/
| explanation = 
* The project team has actively supported the deployment of modules on Punjabi, Tamil, and Indonesian Wikisources. The bot is running on Punjabi Wikisource.
* A small [[:c:File:KCVelaga at Stay safe, stay connected - Session II.webm|presentation]] was made as “Stay safe, stay connected” Session II organized CIS-A2K.
}}
{{PEG/Proposals/Reports/Final/Table/1/Row
| target outcome = Outlining opportunities
| achieved outcome = https://diff.wikimedia.org/2021/06/30/potential-opportunities-to-improve-integration-between-wikisource-and-wikidata-2021/| explanation =* The project development along with further research and conversations with community members helped us to ideate a few interventions that further the use of linked data on Wikisource (largely on Wikidata). Though these are not “only” possibilities, it can be a good start, instead of beginning from the scratch again. 
}}



<!--Leave the template that follows when you have added all of your goals-->
{{PEG/Proposals/Reports/Final/Table/1/End}}

==Lessons learned==
''Projects do not always go according to plan. Sharing what you learned can help you and others plan similar projects in the future. Help the movement learn from your experience by answering the following questions:''
*What worked well?
:* We received consistent support from the Wikimedia Foundation staff and the community members whenever required. Especially during the initial phase of the setup and getting hold of the existing code base, this support had been crucial for us to move forward.
:* Just apart from producing documentation, we are happy to have supported a few communities to deploy the module. It is also happy to see that the communities are very interested in this work.
*What did not work so well?
:* Though the developer on the project is experienced and skilled, not having specific deliverables (i.e. specific technical tools/scripts to be created) ready before the beginning of the project, cost us a lot of time in the initial months to onboard. That would help to better scope the requirements for the project.
:* Though test-Wikisource and test-Wikidata sites intended to be for testing purposes, it seems like the sites are not maintained. We were stuck at a point almost for three weeks as the site didn’t give the intended output, though the code was fine. We only realised this after we did move onto one of the “main” i.e. production wikis. Going forward, these sites should be made similar to test.wikipedia rather than on toolforge.
*What would you do differently next time?
:* Scoping the specific deliverables before the project begins, what time and resources each of them would have required, better, before the project had begun, would have helped to achieve better results.

==Finances==

===Grant funds spent===
''Please describe how much grant money you spent for approved expenses, and tell us what you spent it on. 

* Total spent: 9.909,30 €
:* Project Coordinator / Product Manager: 3.308,19 €
:* Developer: 5.561,56 €
:* Bank/transaction charges: 186,55 €
:* Fiscal sponsor fee: 853,00 €

===Remaining funds===
''Do you have any remaining grant funds?''
*No