Loading...
HomeMy Public PortalAbout2018-06-14 working group Website User Testing Report May.21.2018 Watertown Website User Testing Report Data collected by residents of Watertown May 21 , 2018 Report prepared by CL Tian, new website user testing project coordinator, 3 year Watertown resident, 10+ years experience in web development, founder of PINKOA, a digital agency with web development services. Summary We are committed to Watertown thriving, and by extension, are interested in a website that supports the needs of residents and properly represents our town. In the spirit of an open dialog and collaboration with the town staff and the marketing committee, a group of citizens of Watertown gathered and voluntarily participated in the user testing of the new Watertown website by CivicPlus. The overall findings of the project is that the new website is average (3.3 on a scale of 1 easy to 5 difficult) in ease of navigation/usability the finding of the user groups. Of importance to address pre-launch/immediately post-launch are a few tasks that had a high rate of incompletion (sign up for emergency notifications and finding old town minutes), misspellings, and 404 pages/broken links. A learning curve is expected with any new website launch. As such, many expressed that it was more difficult than expected to find what they needed and understand the logic of link placements. Whether these challenges are attributable solely to user education or point to a deeper design issue remains to be seen in the coming months. Our findings conditionally support launching the website according to the timeline with assurances that 1) functionality issues outlined below will be addressed; 2) responsive issues will be fixed by CivicPlus per page 2 of the contract "CivicPlus Redesign Project Deliverables - New responsive design." and 3) either the town or CivicPlus remedy broken links in a timely manner. This report created using data from testing that was conducted between Friday, May 11, 2018 to Monday, May 14, 2018 and publicly available documents about this project such as the CivicPlus proposal and meeting minutes. 1 User Testing Tasks All users were asked to conduct a series of common tasks on the website, provide qualitative feedback on their experience navigating the website on a variety of devices, and give examples of bugs. The technical user group was asked more specific questions about providing navigation paths. Common Tasks • Sign up for Emergency Alerts • Find payment page for Real Estate Tax • Find payment page for License • Find payment page for Certificates • Submit request for service • Sign up for Updates • Find job board and download an application • Find contact info of town manager • Find old minutes from a meeting • View property info Qualitative Feedback Questions • Please provide more detail about any tasks you could not complete • How easy was it to find what you needed overall? (non-technical only) • How easy was it to navigate the website? Testing Groups Website testing feedback was submitted 15 times (7 by non-technical; 8 by technical). Non-technical users are individuals in Watertown who have no particular experience in web development. Technical users are individuals in Watertown who have experience with web development projects either managing them as a work project and/or developing websites/managing teams who develop website projects. 2 Non-Technical Technical Device Browser Chrome Chrome Safari Safari *Flrefox Firefox Internet Explorer Microsoft Edge Device ■Desktop Tablet* p /Laptop Aga *Tablet �Tablet S mar[phone !Smartphone Website Feedback How easy was the website to navigate? Average is 3.3 on a scale of 1 easy to 5 difficult. Non-Technical Technical (1 easy to 5 difficult) z ou 1 2 3 4 5 2 3 4 3 Qualitative Feedback Positive/Neutral Negative Design: Mobile Experience • It looks nice except for the position of • Much more cumbersome to use web "translation" which is half a line above app from phone. "site tools" which looks kind of weird. • Clunky as is not an interface primarily • Nice simple design. designed for smaller screens, but • OK manageable. • When shrinking window on a laptop, the icons and text overlap-don't scale properly, and when footer menus User Experience • The content buckets for the main nav are unclear. • Online payments being listed under city services is not obvious. Specific Recommendations Based on the data from the user testing, we conditionally support the launch of the new website. We request the following functionality be resolved prior to launch or with a specific post-launch go live plan given the importance or prominence: Functionality o Make it easier to find Sign up for Emergency Alerts E@3y = h:ledium Di�i-_jlt Incomplete 3 1 n 4 User feedback: There is something wrong with the emergency alert link. It's relatively easy to find (although you have to scroll down) but it doesn't take you straight to the emergency alerts but to the overall news flash. FYI, after searching around that page I was able to find emergency alerts, but it took me forever to figure it out. Emergency alerts takes you to news and announcements. You have to go to the bottom of the page to find Notify Me and sign up for emergency alerts from there. That wouldn't be so bad except there is a huge link to "Emergency Watertown Alerts" and you would expect it to take you directly to the Watertown Alerts. o Fix the search function Example: Searching "Department of Public Works" ,}to wzmatertown.ma.Ls i earch?sea rchPhrase=department+oi+public+works 1Pad• x -•,a 100%. Dnhne. Town of Watertown 0 Search --- Responsiveness o Fix button placement on home page at smaller screen widths W'AT r'!'ouuded in l'eureW TF:6n/V Residents Business Government City Services Visitors Haw Dul... WA 1 / ILIO[iL</iYrLLd e • O !'m Seaichmg For. Q I'm Searching For._ L Q (mobile and ipad view) 5 Links o Have post-launch plan to fix all broken links We understand that during the pre-launch period, there may be broken links between staging environment and live sites. � � P Y 1 e �r Wero sorry,bu-irvoo is not a weo page manng yovreniry Contact For questions about this report, please contact CL Tian at cl(c)-oinkoa.com or 617-359-7343. 6