VisualEditor/Design/User testing - Revision history

Clump: Reverted edits by 192.12.184.6 (talk) to last version by Clump

2020-10-21T14:37:42Z

Reverted edits by 192.12.184.6 (talk) to last version by Clump

@@ Line 10: / Line 10: @@
 * Look for other problems not related to the tasks at hand
 * Recommend changes to address these problems
 == 2013–14 Q4 testing ==

192.12.184.6 at 14:37, 21 October 2020

2020-10-21T14:37:18Z

@@ Line 10: / Line 10: @@
 * Look for other problems not related to the tasks at hand
 * Recommend changes to address these problems
 == 2013–14 Q4 testing ==

Clump: Reverted edits by 173.27.121.244 (talk) to last version by Whatamidoing (WMF)

2020-05-18T11:46:21Z

Reverted edits by 173.27.121.244 (talk) to last version by Whatamidoing (WMF)

← Older revision		Revision as of 11:46, 18 May 2020
Line 75:		Line 75:

	==== Next test ideas ====		==== Next test ideas ====
	*~~[[Facebook~~ ~~Open Academy/Cron\|~~Watch]] more experienced editors use VE.		* Watch more experienced editors use VE.
	* Do a comparison with 1st group - Wikitext users, 2nd group - VE users		* Do a comparison with 1st group - Wikitext users, 2nd group - VE users

Line 82:		Line 82:
	[[File:July31 toolbar.png\|thumb\|July31 toolbar\|none\|700x700px]]		[[File:July31 toolbar.png\|thumb\|July31 toolbar\|none\|700x700px]]
	[[File:July31 cite menu.png\|thumb\|July31 cite menu\|none\|243x243px]]		[[File:July31 cite menu.png\|thumb\|July31 cite menu\|none\|243x243px]]
	[[File:~~Visual~~ ~~Editor~~ ~~Usability Testing (Usertesting.com)~~.~~pdf\|alt=\|none~~\|thumb~~\|135x135px~~\|July31 insert menu]]		[[File:July31 insert menu.png\|thumb\|July31 insert menu\|none\|187x187px]]
	We again surveyed 5 people with ~~account~~		We again surveyed 5 people with usertesting.com. The tasks:
	facebook.com.google.com

	The tasks:
	* Enter text		* Enter text
	* Add a '''special character''' using toolbar		* Add a '''special character''' using toolbar
Line 100:		Line 97:
	==== Creating a''' link ''' ====		==== Creating a''' link ''' ====
	* "I was expecting something like a page. I guess this is already a link? But I'll just click Done"<br>		* "I was expecting something like a page. I guess this is already a link? But I'll just click Done"<br>
	* "I don't know whether this is functional link because it doesn't have a page connect, it needs to be connected to some other page, but it seems for the sake of the test to have worked, it has this line on hover..."[video clip]		* "I don't know whether this is functional link because it doesn't have a page connect, it needs to be connected to some other page, but it seems for the sake of the test to have worked, it has this line on hover..."[[https://www.usertesting.com/videos/T-fCe8myNn9UfizguDv8hA/clips/546930\|View video clip]]
	'''''Recommendations: '''''		'''''Recommendations: '''''

Line 107:		Line 104:
	* Say "page exists" with a check or "page does not exist"		* Say "page exists" with a check or "page does not exist"
	* Include first sentence of article		* Include first sentence of article
	* Allow for hovercards, which shows both image and text, but harder to discover		* Allow for [[hovercards]], which shows both image and text, but harder to discover
	* Easier way to visit the page		* Easier way to visit the page

Line 133:		Line 130:
	The first task was to highlight Impressionist, then make it link to Impressionism. Most users struggled with this task, only 2 out of 5 were able to complete it. One of those users were not sure that they completed it successfully. "It has an underline, so I would assume that will link correctly to the article." A few users had trouble with changing the text to "Impressionism" and looked for other places in the article that had the word instead of typing it out themselves.		The first task was to highlight Impressionist, then make it link to Impressionism. Most users struggled with this task, only 2 out of 5 were able to complete it. One of those users were not sure that they completed it successfully. "It has an underline, so I would assume that will link correctly to the article." A few users had trouble with changing the text to "Impressionism" and looked for other places in the article that had the word instead of typing it out themselves.

			View [https://www.usertesting.com/videos/j-l5rvq1gn33pywlefYXWg/clips/540415 video clip]
	View google.com

	'''''Recommendations'''''		'''''Recommendations'''''

173.27.121.244: www.gmail.com

2020-05-18T11:44:59Z

www.gmail.com

← Older revision		Revision as of 11:44, 18 May 2020
Line 75:		Line 75:

	==== Next test ideas ====		==== Next test ideas ====
	* Watch more experienced editors use VE.		*[[Facebook Open Academy/Cron\|Watch]] more experienced editors use VE.
	* Do a comparison with 1st group - Wikitext users, 2nd group - VE users		* Do a comparison with 1st group - Wikitext users, 2nd group - VE users

Line 82:		Line 82:
	[[File:July31 toolbar.png\|thumb\|July31 toolbar\|none\|700x700px]]		[[File:July31 toolbar.png\|thumb\|July31 toolbar\|none\|700x700px]]
	[[File:July31 cite menu.png\|thumb\|July31 cite menu\|none\|243x243px]]		[[File:July31 cite menu.png\|thumb\|July31 cite menu\|none\|243x243px]]
	[[File:~~July31~~ ~~insert~~ ~~menu~~.~~png~~\|thumb\|July31 insert menu~~\|none\|187x187px~~]]		[[File:Visual Editor Usability Testing (Usertesting.com).pdf\|alt=\|none\|thumb\|135x135px\|July31 insert menu]]
	We again surveyed 5 people with ~~usertesting.com. The tasks:~~		We again surveyed 5 people with account
			facebook.com.google.com

			The tasks:
	* Enter text		* Enter text
	* Add a '''special character''' using toolbar		* Add a '''special character''' using toolbar
Line 97:		Line 100:
	==== Creating a''' link ''' ====		==== Creating a''' link ''' ====
	* "I was expecting something like a page. I guess this is already a link? But I'll just click Done"<br>		* "I was expecting something like a page. I guess this is already a link? But I'll just click Done"<br>
	* "I don't know whether this is functional link because it doesn't have a page connect, it needs to be connected to some other page, but it seems for the sake of the test to have worked, it has this line on hover..."[~~[https://www.usertesting.com/videos/T-fCe8myNn9UfizguDv8hA/clips/546930\|View~~ video clip]]		* "I don't know whether this is functional link because it doesn't have a page connect, it needs to be connected to some other page, but it seems for the sake of the test to have worked, it has this line on hover..."[video clip]
	'''''Recommendations: '''''		'''''Recommendations: '''''

Line 104:		Line 107:
	* Say "page exists" with a check or "page does not exist"		* Say "page exists" with a check or "page does not exist"
	* Include first sentence of article		* Include first sentence of article
	* Allow for [[hovercards]], which shows both image and text, but harder to discover		* Allow for hovercards, which shows both image and text, but harder to discover
	* Easier way to visit the page		* Easier way to visit the page

Line 130:		Line 133:
	The first task was to highlight Impressionist, then make it link to Impressionism. Most users struggled with this task, only 2 out of 5 were able to complete it. One of those users were not sure that they completed it successfully. "It has an underline, so I would assume that will link correctly to the article." A few users had trouble with changing the text to "Impressionism" and looked for other places in the article that had the word instead of typing it out themselves.		The first task was to highlight Impressionist, then make it link to Impressionism. Most users struggled with this task, only 2 out of 5 were able to complete it. One of those users were not sure that they completed it successfully. "It has an underline, so I would assume that will link correctly to the article." A few users had trouble with changing the text to "Impressionism" and looked for other places in the article that had the word instead of typing it out themselves.

			View google.com
	View [https://www.usertesting.com/videos/j-l5rvq1gn33pywlefYXWg/clips/540415 video clip]

	'''''Recommendations'''''		'''''Recommendations'''''

Whatamidoing (WMF) at 19:17, 25 March 2020

2020-03-25T19:17:49Z

← Older revision		Revision as of 19:17, 25 March 2020
Line 1:		Line 1:
			{{Historical\|VisualEditor is still maintained, but this page isn't being updated.}}

	We test VisualEditor with users who are unfamiliar with the software and often who are unfamiliar with editing so that we can see how intuitive the interface is.		We test VisualEditor with users who are unfamiliar with the software and often who are unfamiliar with editing so that we can see how intuitive the interface is.

Clump: Reverted edits by 49.148.79.134 (talk) to last version by Mainframe98

2019-04-18T17:30:38Z

Reverted edits by 49.148.79.134 (talk) to last version by Mainframe98

← Older revision		Revision as of 17:30, 18 April 2019
Line 9:		Line 9:
	* Recommend changes to address these problems		* Recommend changes to address these problems

			== 2013–14 Q4 testing ==
	format-04-16-2019 update origonal setting

			=== Test 1 - May 20, 2014 ===
			[[File:Screenshot of toolbar as of June 2014.png\|thumb\|screenshot of toolbar as existed in June 2014\|none\|600x600px]]
			[[File:Screenshot of insert menu as of June 2014.png\|thumb\|screenshot of insertion menu as existed in June 2014\|none\|177x177px]]
			We surveyed 5 people with usertesting.com. Each participant was introduced into an example article in VisualEditor mode and asked to complete a few tasks, typical to basic editing:
			* Enter text
			* Add a '''special character''' to text using toolbar
			* Create a '''link'''
			* Make text '''italic'''
			* Enter title, make it a '''subheading'''
			* Enter text, make it a paragraph under the subheading
			* Add a '''picture'''
			* '''Save''' their edits
			In general, users were able to quickly find what they needed on the toolbar and complete the tasks. But often they were not sure if they had completed the task successfully.

			==== '''Finding things''' ====
	format summary edetorpage and remove edit link
			Users generally found things either right away or by looking through toolbar menus from left to right.

			Sometimes when users couldn't find something looked to the left sidebar under tools. [https://www.usertesting.com/videos/zb6EPAy1wGV1x7l_E-TmlQ/clips/640860\|Video clip]

			'''''Recommendations:'''''
			* Less clutter:
			** {{Done\|Done in [https://www.mediawiki.org/wiki/VisualEditor/status#2014-05-29_.28MW_1.24wmf7.29 1.24wmf7]}} Move bullet lists into their own menu
			** Consider moving bullet items elsewhere – possibly the text formatting menu.
			** Try moving the section menu into the text formatting menu.
			** Run a card sorting test to see if users expect different ways of organizing the toolbar.
			** Adopt a principle of having the most commonly used tools to the left of the toolbar.
			** Re-prioritize some of the items in the menus.
			** Break up into groups.
			* Special Character: widen the dialog to make it easier to scan through, and break characters up into smaller groups

			==== '''Link''' ====
			Most users were not sure they successfully added a link.

			'''''Recommendations:'''''
			* Add a check button or something to show a user confirmation.
			* Add a way for user to go open the link in another tab.

			==== '''Picture''' ====
			Some users struggled to add a picture. 2 users tried to go to insert > gallery, and got really lost. Once a user had added a picture, they weren't sure that they had successfully added it to the correct place.

			'''''Recommendations:'''''
			* {{Done\|Done in [https://www.mediawiki.org/wiki/VisualEditor/status#2014-05-29_.28MW_1.24wmf7.29 1.24wmf7]}} Remove "gallery" from the insert menu because it's confusing for most users and very rarely something they want.
			* Move media icon to top-level toolbar.
			* Change dialogue title to "Add images or video" – field in [[phab:T175960]]
			* Be able to add gallery from this dialogue?
			* Improve drag and drop, and indicate somehow that images fall where they can fit on right rail

			==== '''Save ''' ====
			Most users saved easily and felt they had done it right. One user wanted to fill out a detailed edit summary and struggled to remember what she had changed.

			'''''Recommendations:'''''
			* Move save dialogue to be anchored to the top right, closer to save button, so that user can more easily see their changes.
			* Have summary filled automatically

			==== '''Edit source vs Edit beta''' ====
			One user upon entering test immediately clicked edit source and never found VisualEditor.

			'''''Recommendations:'''''
			* One tab, with ability to switch in the toolbar.
			* Tooltips – Give more information in link and reference tooltips so a user can quickly read / decide if they want to edit them.

			==== Next test ideas ====
			* Watch more experienced editors use VE.
			* Do a comparison with 1st group - Wikitext users, 2nd group - VE users

	== Q1 2014–2015 testing ==		== Q1 2014–2015 testing ==

49.148.79.134: 9018-format testing-2019

2019-04-18T17:25:14Z

9018-format testing-2019

← Older revision		Revision as of 17:25, 18 April 2019
Line 9:		Line 9:
	* Recommend changes to address these problems		* Recommend changes to address these problems

			format-04-16-2019 update origonal setting
	== 2013–14 Q4 testing ==

49.148.79.134: Test 1 - format 04-16-2019 update original setting

2019-04-18T17:22:41Z

Test 1 - format 04-16-2019 update original setting

← Older revision		Revision as of 17:22, 18 April 2019
Line 11:		Line 11:
	== 2013–14 Q4 testing ==		== 2013–14 Q4 testing ==

	=== Test 1 - May 20, 2014 ===
	[[File:Screenshot of toolbar as of June 2014.png\|thumb\|screenshot of toolbar as existed in June 2014\|none\|600x600px]]
	[[File:Screenshot of insert menu as of June 2014.png\|thumb\|screenshot of insertion menu as existed in June 2014\|none\|177x177px]]
	We surveyed 5 people with usertesting.com. Each participant was introduced into an example article in VisualEditor mode and asked to complete a few tasks, typical to basic editing:
	* Enter text
	* Add a '''special character''' to text using toolbar
	* Create a '''link'''
	* Make text '''italic'''
	* Enter title, make it a '''subheading'''
	* Enter text, make it a paragraph under the subheading
	* Add a '''picture'''
	* '''Save''' their edits
	In general, users were able to quickly find what they needed on the toolbar and complete the tasks. But often they were not sure if they had completed the task successfully.

			format summary edetorpage and remove edit link
	==== '''Finding things''' ====
	Users generally found things either right away or by looking through toolbar menus from left to right.

	Sometimes when users couldn't find something looked to the left sidebar under tools. [https://www.usertesting.com/videos/zb6EPAy1wGV1x7l_E-TmlQ/clips/640860\|Video clip]

	'''''Recommendations:'''''
	* Less clutter:
	** {{Done\|Done in [https://www.mediawiki.org/wiki/VisualEditor/status#2014-05-29_.28MW_1.24wmf7.29 1.24wmf7]}} Move bullet lists into their own menu
	** Consider moving bullet items elsewhere – possibly the text formatting menu.
	** Try moving the section menu into the text formatting menu.
	** Run a card sorting test to see if users expect different ways of organizing the toolbar.
	** Adopt a principle of having the most commonly used tools to the left of the toolbar.
	** Re-prioritize some of the items in the menus.
	** Break up into groups.
	* Special Character: widen the dialog to make it easier to scan through, and break characters up into smaller groups

	==== '''Link''' ====
	Most users were not sure they successfully added a link.

	'''''Recommendations:'''''
	* Add a check button or something to show a user confirmation.
	* Add a way for user to go open the link in another tab.

	==== '''Picture''' ====
	Some users struggled to add a picture. 2 users tried to go to insert > gallery, and got really lost. Once a user had added a picture, they weren't sure that they had successfully added it to the correct place.

	'''''Recommendations:'''''
	* {{Done\|Done in [https://www.mediawiki.org/wiki/VisualEditor/status#2014-05-29_.28MW_1.24wmf7.29 1.24wmf7]}} Remove "gallery" from the insert menu because it's confusing for most users and very rarely something they want.
	* Move media icon to top-level toolbar.
	* Change dialogue title to "Add images or video" – field in [[phab:T175960]]
	* Be able to add gallery from this dialogue?
	* Improve drag and drop, and indicate somehow that images fall where they can fit on right rail

	==== '''Save ''' ====
	Most users saved easily and felt they had done it right. One user wanted to fill out a detailed edit summary and struggled to remember what she had changed.

	'''''Recommendations:'''''
	* Move save dialogue to be anchored to the top right, closer to save button, so that user can more easily see their changes.
	* Have summary filled automatically

	==== '''Edit source vs Edit beta''' ====
	One user upon entering test immediately clicked edit source and never found VisualEditor.

	'''''Recommendations:'''''
	* One tab, with ability to switch in the toolbar.
	* Tooltips – Give more information in link and reference tooltips so a user can quickly read / decide if they want to edit them.

	==== Next test ideas ====
	* Watch more experienced editors use VE.
	* Do a comparison with 1st group - Wikitext users, 2nd group - VE users

	== Q1 2014–2015 testing ==		== Q1 2014–2015 testing ==

Mainframe98: Reverted edits by 121.211.97.19 (talk) to last version by Volker E. (WMF)

2018-09-14T14:17:58Z

Reverted edits by 121.211.97.19 (talk) to last version by Volker E. (WMF)

Show changes

121.211.97.19: Replaced content with " * * * * *"

2018-09-14T14:05:35Z

Replaced content with " * * * * *"

Show changes