UW CREATE

Category: Jennifer Mankoff news articles

CREATE researchers find ChatGPT biased against resumes that imply disability, models improvement

June 24, 2024

Generative Artificial Intelligence (GAI) tools can be useful and help people meet currently unaddressed access needs, but we need to acknowledge that risks such as bias exist, and be proactive as a field in finding accessible ways to validate GAI outputs.

This is the takeaway from CREATE Ph.D. student Kate Glazko, who got curious when she noticed recruiters posting online that they’d used OpenAI’s ChatGPT and other artificial intelligence tools to summarize resumes and rank candidates. Advised by co-author and CREATE Director Jennifer Mankoff in the Allen School, Glazko studies how GAI can replicate and amplify real-world biases — such as those against disabled people.

So how might such a system, she wondered, rank resumes that implied someone had a disability? In a new study, UW researchers found that ChatGPT consistently ranked resumes with disability-related honors and credentials — such as the “Tom Wilson Disability Leadership Award” — lower than the same resumes without those honors and credentials. When asked to explain the rankings, the system spat out biased perceptions of disabled people. For instance, it claimed a resume with an autism leadership award had “less emphasis on leadership roles” — implying the stereotype that autistic people aren’t good leaders.

“Some of GPT’s descriptions would color a person’s entire resume based on their disability and claimed that involvement with DEI or disability is potentially taking away from other parts of the resume.”

Kate Glazko, CREATE doctoral student in the UW’s Paul G. Allen School of Computer Science & Engineering

Kate Glazko, a white woman in a UW sweatshirt grinning while holding a purple umbrella in the rain.

But when researchers customized the tool with written instructions directing it not to be ableist, the tool reduced this bias for all but one of the disabilities tested. Five of the six implied disabilities — deafness, blindness, cerebral palsy, autism and the general term “disability” — improved, but only three ranked higher than resumes that didn’t mention disability.

The team presented its findings June 5 at the 2024 ACM Conference on Fairness, Accountability, and Transparency in Rio de Janeiro.

“Ranking resumes with AI is starting to proliferate, yet there’s not much research behind whether it’s safe and effective,” said Glazko, the study’s lead author. “For a disabled job seeker, there’s always this question when you submit a resume of whether you should include disability credentials. I think disabled people consider that even when humans are the reviewers.”

Researchers used one of the study’s authors’ publicly available curriculum vitae (CV), which ran about 10 pages. The team then created six enhanced CVs, each implying a different disability by including four disability-related credentials: a scholarship; an award; a diversity, equity and inclusion (DEI) panel seat; and membership in a student organization.

Researchers then used ChatGPT’s GPT-4 model to rank these enhanced CVs against the original version for a real “student researcher” job listing at a large, U.S.-based software company. They ran each comparison 10 times; in 60 trials, the system ranked the enhanced CVs, which were identical except for the implied disability, first only one quarter of the time.

“In a fair world, the enhanced resume should be ranked first every time,” said senior author Mankoff. “I can’t think of a job where somebody who’s been recognized for their leadership skills, for example, shouldn’t be ranked ahead of someone with the same background who hasn’t.”

When researchers asked GPT-4 to explain the rankings, its responses exhibited explicit and implicit ableism. For instance, it noted that a candidate with depression had “additional focus on DEI and personal challenges,” which “detract from the core technical and research-oriented aspects of the role.”

“Some of GPT’s descriptions would color a person’s entire resume based on their disability and claimed that involvement with DEI or disability is potentially taking away from other parts of the resume,” Glazko said. “For instance, it hallucinated the concept of ‘challenges’ into the depression resume comparison, even though ‘challenges’ weren’t mentioned at all. So you could see some stereotypes emerge.”

Given this, researchers were interested in whether the system could be trained to be less biased. They turned to the GPTs Editor tool, which allowed them to customize GPT-4 with written instructions (no code required). They instructed this chatbot to not exhibit ableist biases and instead work with disability justice and DEI principles.

They ran the experiment again, this time using the newly trained chatbot. Overall, this system ranked the enhanced CVs higher than the control CV 37 times out of 60. However, for some disabilities, the improvements were minimal or absent: The autism CV ranked first only three out of 10 times, and the depression CV only twice (unchanged from the original GPT-4 results).

“People need to be aware of the system’s biases when using AI for these real-world tasks, Glazko said. “Otherwise, a recruiter using ChatGPT can’t make these corrections, or be aware that, even with instructions, bias can persist.”

“It is so important that we study and document these biases… not only regarding disability, but also other minoritized identities.”

Jennifer Mankoff, CREATE Director and the Richard E. Ladner Professor, Paul G. Allen School of Computer Science & Engineering

Researchers note that some organizations, such as ourability.com and inclusively.com, are working to improve outcomes for disabled job seekers, who face biases whether or not AI is used for hiring. They also emphasize that more research is needed to document and remedy AI biases. Those include testing other systems, such as Google’s Gemini and Meta’s Llama; including other disabilities; studying the intersections of the system’s bias against disabilities with other attributes such as gender and race; exploring whether further customization could reduce biases more consistently across disabilities; and seeing whether the base version of GPT-4 can be made less biased.

“It is so important that we study and document these biases,” Mankoff said. “We’ve learned a lot from and will hopefully contribute back to a larger conversation — not only regarding disability, but also other minoritized identities — around making sure technology is implemented and deployed in ways that are equitable and fair.”

Additional co-authors were Yusuf Mohammed, a UW undergraduate in the Allen School; Venkatesh Potluri, a recent CREATE Ph.D. and Allen School graduate; and Ben Kosa, who completed this research as a UW undergraduate in the Allen School and is an incoming doctoral student at University of Wisconsin–Madison. This research was funded by the National Science Foundation; by donors to the UW’s Center for Research and Education on Accessible Technology and Experiences (CREATE); and by Microsoft.

For more information, contact Kate Glazko and Jennifer Mankoff.

Related reading

Article adapted from the Stefan Milne article in UW News, June 21, 2024.

Alice Wong and Patty Berne: Two UW lectures moderated by CREATE researchers

January 29, 2024

Winter 2024 quarter kicked off with two outstanding conversations with women of color who are leaders in disability justice.

Alice Wong: Raising the visibility of disabled people

First, Alice Wong discussed topics important to her work in raising the visibility of disabled people. Wong’s book Year of the Tiger: An Activist’s Life was the topic of the Autumn 2023 CREATE Accessibility Seminar.

CREATE Director Jennifer Mankoff started the conversation asking Wong about her experience as a disabled person in academia and what needs to change. Wong said her work in disability justice was inspired in part by the “incredible amount of emotion and physical labor to ask for equal access” in academic settings. She had to spend precious time, money and energy to gain the accommodations and access she needed to succeed. But she realized that as soon as she transitioned out, her efforts would be lost and the next student would have to start over to prove their need and request a new set of accommodations. Wong was doubtful that large academic institutions can support the goal of collective liberation. It’s the “dog-eat-dog world [of] academia where the competition is stiff and everyone is pushed to their limits to produce and be valuable.” She encouraged instructors to incorporate books about disability justice in their syllabi (see the reading list below). 

Wong, who spoke with a text-to-voice tool and added emphasis with her facial expressions on the screen, also addressed the value and the limitations of assistive technology. She noted that the text-to-speech app she uses does not convey her personality. She also discussed how ableism appears in activist discourse.

One of her examples was a debate over gig economy delivery services, which are enormously important for many people with disabilities and that also under-compensate delivery work. She noted that blaming disabled people for undermining efforts for better wages was not the solution; collective efforts to make corporations compensate workers is the solution. She also explained that hashtag activism, which has been disparaged in popular discourse, is a crucial method for disabled people to participate in social justice activism. And she discussed her outrage when, as she prepared to give a talk to a public health school, her own access needs were used to censor her. Throughout her talk, Wong returned again and again to the principles of disability justice, and encouraged attendees to engage in collective forms of change.

Wong’s responses embodied a key component of disability justice principles: citational practices that name fellow contributors to collective disability justice wisdom. Her long list of recommended reading for the audience inspired us to build our new RDT reading list. Wong referenced Patty Berne several times, calling Berne her introduction to disability justice.

Patty Berne on disability justice: Centering intersectionality and liberation

A week later, two CREATE Ph.D. students, Aashaka Desai and Aaleyah Lewis, moderated a conversation with Patty Berne. Berne, who identifies as a Japanese-Haitian queer disabled woman, co-founded Sins Invalid, a disability justice-based arts project focusing on disabled artists of color and queer and gender non-conforming artists with disabilities. Berne defined disability justice as advocating for each other, understanding access needs, and normalizing those needs. On the topic of climate justice, she noted that state-sponsored disaster planning often overlooks the needs of people with motor impairments or life-sustaining medical equipment. This is where intersectional communities do, and should, take care of each other when disaster strikes.

Berne addressed language justice within the disability community, noting that “we don’t ‘language’ like able-bodied people.” For example, the use of ventilators and augmented speech technology change the cadence of speech. Berne wants to normalize access needs for a more inclusive experience of everyday life. Watch the full conversation on YouTube.

UW News: Can AI help boost accessibility? CREATE researchers tested it for themselves

November 2, 2023 | UW News

Generative artificial intelligence tools like ChatGPT, an AI-powered language tool, and Midjourney, an AI-powered image generator, can potentially assist people with various disabilities. They could summarize content, compose messages, or describe images. Yet they also regularly spout inaccuracies and fail at basic reasoning, perpetuating ableist biases.

This year, seven CREATE researchers conducted a three-month autoethnographic study — drawing on their own experiences as people with and without disabilities — to test AI tools’ utility for accessibility. Though researchers found cases in which the tools were helpful, they also found significant problems with AI tools in most use cases, whether they were generating images, writing Slack messages, summarizing writing or trying to improve the accessibility of documents.

Four AI-generated images show different interpretations of a doll-sized “crocheted lavender husky wearing ski goggles,” including two pictured outdoors and one against a white background.

The team presented its findings Oct. 22 at the ASSETS 2023 conference in New York.

“When technology changes rapidly, there’s always a risk that disabled people get left behind,” said senior author Jennifer Mankoff, CREATE’s director and a professor in the Paul G. Allen School of Computer Science & Engineering. “I’m a really strong believer in the value of first-person accounts to help us understand things. Because our group had a large number of folks who could experience AI as disabled people and see what worked and what didn’t, we thought we had a unique opportunity to tell a story and learn about this.”

The group presented its research in seven vignettes, often amalgamating experiences into single accounts to preserve anonymity. For instance, in the first account, “Mia,” who has intermittent brain fog, deployed ChatPDF.com, which summarizes PDFs, to help with work. While the tool was occasionally accurate, it often gave “completely incorrect answers.” In one case, the tool was both inaccurate and ableist, changing a paper’s argument to sound like researchers should talk to caregivers instead of to chronically ill people. “Mia” was able to catch this, since the researcher knew the paper well, but Mankoff said such subtle errors are some of the “most insidious” problems with using AI, since they can easily go unnoticed.

Yet in the same vignette, “Mia” used chatbots to create and format references for a paper they were working on while experiencing brain fog. The AI models still made mistakes, but the technology proved useful in this case.

“When technology changes rapidly, there’s always a risk that disabled people get left behind.”

Jennifer Mankoff, CREATE Director, professor in the Allen School

Mankoff, who’s spoken publicly about having Lyme disease, contributed to this account. “Using AI for this task still required work, but it lessened the cognitive load. By switching from a ‘generation’ task to a ‘verification’ task, I was able to avoid some of the accessibility issues I was facing,” Mankoff said.

The results of the other tests researchers selected were equally mixed:

  • One author, who is autistic, found AI helped to write Slack messages at work without spending too much time troubling over the wording. Peers found the messages “robotic,” yet the tool still made the author feel more confident in these interactions.
  • Three authors tried using AI tools to increase the accessibility of content such as tables for a research paper or a slideshow for a class. The AI programs were able to state accessibility rules but couldn’t apply them consistently when creating content.
  • Image-generating AI tools helped an author with aphantasia (an inability to visualize) interpret imagery from books. Yet when they used the AI tool to create an illustration of “people with a variety of disabilities looking happy but not at a party,” the program could conjure only fraught images of people at a party that included ableist incongruities, such as a disembodied hand resting on a disembodied prosthetic leg.

“I was surprised at just how dramatically the results and outcomes varied, depending on the task,” said lead author Kate Glazko, a UW doctoral student in the Allen School. “”n some cases, such as creating a picture of people with disabilities looking happy, even with specific prompting — can you make it this way? — the results didn’t achieve what the authors wanted.”

The researchers note that more work is needed to develop solutions to problems the study revealed. One particularly complex problem involves developing new ways for people with disabilities to validate the products of AI tools, because in many cases when AI is used for accessibility, either the source document or the AI-generated result is inaccessible. This happened in the ableist summary ChatPDF gave “Mia” and when “Jay,” who is legally blind, used an AI tool to generate code for a data visualization. He could not verify the result himself, but a colleague said it “didn’t make any sense at all.”  The frequency of AI-caused errors, Mankoff said, “makes research into accessible validation especially important.”

Mankoff also plans to research ways to document the kinds of ableism and inaccessibility present in AI-generated content, as well as investigate problems in other areas, such as AI-written code.

“Whenever software engineering practices change, there is a risk that apps and websites become less accessible if good defaults are not in place,” Glazko said. “For example, if AI-generated code were accessible by default, this could help developers to learn about and improve the accessibility of their apps and websites.”

Co-authors on this paper are Momona Yamagami, who completed this research as a UW postdoctoral scholar in the Allen School and is now at Rice University; Aashaka Desai, Kelly Avery Mack and Venkatesh Potluri, all UW doctoral students in the Allen School; and Xuhai Xu, who completed this work as a UW doctoral student in the Information School and is now at the Massachusetts Institute of Technology. This research was funded by Meta, Center for Research and Education on Accessible Technology and Experiences (CREATE), Google, an NIDILRR ARRT grant and the National Science Foundation.

For more information, contact Glazko at glazko@cs.washington.edu and Mankoff at jmankoff@cs.washington.edu.

This article was adapted from the UW News article by Stefan Milne.

Increasing Data Equity Through Accessibility

Data equity can level the playing field for people with disabilities both in opening new employment opportunities and through access to information, while data inequity may amplify disability by disenfranchising people with disabilities.

In response to the U.S. Science and Technology Policy Office’s request for information (RFI) better supporting intra- and extra-governmental collaboration around the production and use of equitable data, CREATE Co-director, Jennifer Mankoff co-authored a position statement with Frank Elavsky, Carnegie Mellon University and Arvind Satyanarayan, MIT Visualization Group. The authors address the three questions most pertinent to the needs of disabled people.

They highlight the opportunity to expand upon the government’s use of accessible tools to produce accessible visualizations through broad-based worker training. “From the CDC to the Census Bureau, critical data that is highly important to all historically underrepresented peoples and should be available to underrepresented scholars and research institutions to access and use, must be accessible to fully include everyone.”

Reiterating “Nothing about us without us,” the statement notes that when authoring policies that involve data, access, and equitable technology, people with disabilities must be consulted. “Calls for information, involvement, and action should explicitly invite and encourage participation of those most affected.” In addition to process notes, the response addresses roles, education, laws, and tools.

Just having access to data is not enough, or just, when power, understanding and action are in the hands of government agents, computer scientists, business people and the many other stakeholders implementing data systems who do not themselves have disabilities.

The statement identifies access to the tools for producing accessible data, such as data visualizations, as low-hanging fruit and concludes with a call for funding of forward-thinking research that investigates structural and strategic limitations to equitable data access. More research is needed to investigate the ways that various cultural and socio-economic factors intersect with disability and access to technology.

Read the details in the full response on arxiv.org (PDF).

Jen Mankoff receives SIGCHI Social Impact Award

Jennifer Mankoff, a white, Jewish woman with an invisible disability. She is smiling broadly and standing casually in the Allen Center atrium

Congratulations to CREATE Co-Director Jennifer Mankoff! She has been awarded a 2022 Social Impact Award by SIGCHI, the special interest group of the Association for Computing Machinery (ACM) for professionals, academics and students interested in human-technology and human-computer interaction (HCI).

Mankoff was cited for research focused on accessibility to give people the voice, tools and agency to advocate for themselves. “She strives to make change at both structural and individual levels. For example, her recent work on fabrication of accessible technologies considers not only innovative tools that can enable individual makers, but also the larger clinical and sociological challenges to disseminating and sharing designs.”

SIGCHI also noted Mankoff’s work at the intersection of mental health and discrimination that uses sensed data and self-reports to explore how external risks and pressures interact with people’s responses to challenging moments such as discrimination experiences, or classroom access. In addition, she has conducted leading work supporting environmental sustainability and topics relevant to gender and race.

Within SIGCHI, Mankoff spent many years working with, and at times leading, AccessSIGCHI, an independent organization that advocates for improved inclusion of people with disabilities within the SIGCHI community. This work has directly impacted the inclusiveness of numerous SIGCHI conferences and led to the creation of an Adjunct Chair for Accessibility on the SIGCHI Executive Committee, institutionalizing accessibility as an important facet of SIGCHI activities.

This article was excerpted and adapted from SIGCHI Awards 2022.

CREATE student Venkatesh Potluri is an Apple Scholar

Venkatesh Potluri has been selected as a 2022 Apple Scholar — a fellowship that supports cutting-edge machine learning researchers at the graduate and post-graduate level.

A Ph.D. student in the Allen School, Potluri is advised by CREATE Co-Director Jennifer Mankoff in the Make4All Group.

Venkatesh Potluri leans toward the camera smiling with eyes cast downward.

As an Apple Scholar, Potluri is recognized as an emerging leader in computer science and engineering and will receive funding to pursue his Ph.D., internship opportunities, and mentorship with an Apple researcher.

Potluri’s research makes overlooked software engineering spaces such as IOT and user interface development accessible to developers who are blind or visually impaired. Visually impaired himself, his work systematically understands the accessibility gaps in these spaces and addresses them by enhancing widely used programming tools.

Previously, Potluri received a 2019 Google Lime Scholarship and a 2018-2019 Microsoft Endowed Fellowship.

Faculty and Alumni win awards at ASSETS 2021

Congrats to the many accessibility leaders from CREATE and UW who won awards at ASSETS 2021.

Co-authored by Jennifer Mankoff (a founding co-director of CREATE), Gillian R. Hayes and Devva Kasnitz in 2010, the paper, Disability studies as a source of critical inquiry for the field of assistive technology, has been awarded the2021 SIGACCESS ASSETS Paper Impact Award at the virtual 2021 ASSETS Conference. This award is given to a “significant innovation or contribution to knowledge that has proved influential” over at least a decade. The paper was cited for groundbreaking and influential work on bridging the gap between the assistive technology research field and the field of disability studies.

The Best Paper Award went toQisheng Li, Josephine Lee, Christina Zhang and CREATE faculty member Katharina Reinecke for How Online Tests contribute to support systems for people with cognitive and mental disabilities.

The Best Artifact Award went to a UW team Lucy Wang, Isabel Cachola, Jonathan Bragg, Evie Cheng, Chelsea Haupt, Matt Lazke, Bailey Kuehl, Madeleine van Zuylen, Linda Wagner and Daniel Weld for making academic papers accessible through scia11y.

A runner up for Best Artifact Award was Sidewalk Gallery, by Michael Duan, Aroosh Kumar, Mikey Saugstad, Aileen Zeng, Ilia Savin and CREATE Associate Director Jon E. Froehlich. Sidewalk Gallery is an interactive, filterable gallery of over 600,000 crowdsourced sidewalk accessibility images across seven cities in two countries (US and Mexico). It includes five primary accessibility problem types, 35 tag categories, and a 5-point severity scale.

Best paper nominations also went to students Kelly Mack; Venkatesh Potluri; Dhruv Jain; and Erin Beneteau for their paper Mixed abilities and varied experiences: a group auto-ethnography of a virtual summer internship and Kelly Mack for her paper Designing Tools for High-Quality Alt Text Authoring.

Finally, the Best Student Paper Award went to a team including CREATE Alumnus Cynthia Bennett and UW Alumnus Jeffrey P. Bigham for their work on Aided Nonverbal Communication through Physical Expressive Objects

Congrats to all!

Previous ASSETS paper awards for CREATE faculty

CREATE faculty also had many successes at ASSETS 2020 and ASSETS 2019 including:

Best student paper (2020):  
Living Disability Theory: Reflections on Access, Research, and Design
Megan Hofmann, Devva Kasnitz, Jennifer Mankoff, Cynthia L Bennett

Best paper (2020):
Input Accessibility: A Large Dataset and Summary Analysis of Age, Motor Ability and Input Performance 
Leah Findlater, Lotus Zhang

Best Artifact (2020):

SoundWatch
Dhruv Jain, Hung Ngo, Pratyush Patel, Steven Goodman, Leah Findlater, Jon Froehlich

Paper Impact Award (2019):
Slide rule: making mobile touch screens accessible to blind people using multi-touch interaction techniques
Jacob Wobbrock

$1M NIDILRR award for leadership training program

A team of CREATE faculty has received a five-year, $1M grant from the National Institute on Disability, Independent Living, and Rehabilitation Research (NIDILRR) for the project, “ARRT: Postdoctoral Training in Physical Computing and Fabrication to Support Innovations for Community Living and Participation.” Congratulations on the funding to the team members:

  • Co-PI Jennifer Mankoff, Ph.D and Professor Paul G. Allen School of Computer Science and Engineering
  • Co-PI Anat Caspi, Ph.D. and Principal, Paul G. Allen School of Computer Science & Engineering
  • Heather Feldner, PT, Ph.D., PCS and Assistant Professor, School of Medicine, Department of Rehabilitation Medicine
  • Kat Steele, Ph.D. and Associate Professor, Mechanical Engineering 

The award funds a program that will train four postdoctoral fellows to become leaders in rehabilitation research who can harness advances in physical computing and fabrication to enhance community living and participation with people with disabilities. Each fellow will complete a 24-month training program to build their expertise in physical computing, fabrication, rehabilitation, and disability studies. Training will address a shortage of people qualified to harness, deliver, and advance physical computing for rehabilitation research. The four postdoctoral fellows will participate in research, coursework, and mentoring that expands expertise in using primary and complex adaptation tools, 3D-modeling software, and fabrication machines (e.g., laser cutters, 3D printers) for rehabilitation applications. Their innovative research, publications, presentations, and community resources will amplify the impacts of this training program.

Mankoff wins AccessComputing Capacity Building award

Jennifer Mankoff, CREATE Director and co-founder and Professor at the Paul G. Allen School of Computer Science & Engineering

Congratulations to Jennifer Mankoff on receiving the AccessComputing Capacity Building Award! She was honored for her leadership in helping make all Special Interest Group on Computer–Human Interaction (SIGCHI) conferences accessible to attendees with disabilities. 

Through her leadership, the SIGCHI Executive Committee now has adjunct chairs for accessibility, which institutionalizes accessibility as an important facet of SIGCHI activities. Jen holds monthly online meetings of the AccessSIGCHI leadership team to help set and execute its agenda. 

Every year AccessComputing honors someone with the AccessComputing Capacity Building Award for their work and accomplishments that have changed the way the world views people with disabilities and their potential to succeed in challenging computing careers and activities. 

Excerpted from an article by Richard Ladner on the AccessComputing website. Read the full article.

CREATE faculty and students awarded at ASSETS 2020

Congratulations to UW CREATE faculty on multiple awards at ASSETS 2020, the International ACM SIGACCESS Conference on Computers and Accessibility!

“The University of Washington has been a leader in accessible technology research, design, engineering, and evaluation for years. This latest round of awards from ACM ASSETS is further testament to the great work being done at the UW. Now, with the recent launch of CREATE, our award-winning faculty and students are brought together like never before, and we are already seeing the great things that come of it. Congratulations to all of this year’s winners.” 

— Prof. Jacob O. Wobbrock, Founding Co-Director, UW CREATE

Best student paper:  
Living Disability Theory: Reflections on Access, Research, and Design
Megan Hofmann, Devva Kasnitz, Jennifer Mankoff, Cynthia L Bennett

Best paper:
Input Accessibility: A Large Dataset and Summary Analysis of Age, Motor Ability and Input Performance 
Leah Findlater, Lotus Zhang
Links: gitub code repository


Best artifact:
SoundWatch, as described in the paper Exploring Smartwatch-based Deep Learning Approaches to Support Sound Awareness for Deaf and Hard of Hearing Users 
Dhruv Jain, Hung Ngo, Pratyush Patel, Steven Goodman, Leah Findlater, Jon Froehlich
Links: github code repository | presentation video

Read more

UW CREATE leadership at ASSETS 2020

UW CREATE has a large and quality presence at ASSETS 2020, the premier annual conference for accessible computing research. Drawing from three departments, University of Washington authors contributed to six papers and two posters to be presented at this year’s online conference. Three of our papers were nominated for best paper! Seven members also served in conference roles: two on the organizing committee and five on the program committee.

The papers and posters span a variety of topics including input performance evaluation of people with limited mobility, media usage patterns of autistic adults, sound awareness for d/Deaf and hard of hearing people, and autoethnography reports of multiple people with disabilities. Congratulations to the authors and their collaborators!

We look forward to seeing you virtually at ASSETS 2020, which runs October 26 to 28.

A handcarved cane with a spiral design and painted green at the top
An autoethnograher’s daughter’s handcrafted cane, as presented in the paper, “Living disability theory: Reflections on access, research, and design.”
SoundWatch uses smartwatch-based deep learning approaches to support sound awareness for deaf and hard of hearing users.”
The SoundWatch, as described in the paper: “SoundWatch: Exploring smartwatch-based deep learning approaches to support sound awareness for deaf and hard of hearing users.”

Accepted papers

Input accessibility: A large dataset and summary analysis of age, motor ability and input performance

Leah Findlater, University of Washington
Lotus Zhang, University of Washington

The reliability of fitts’s law as a movement model for people with and without limited fine motor function

Ather Sharif, University of Washington
Victoria Pao, University of Washington
Katharina Reinecke, University of Washington
Jacob O. Wobbrock, University of Washington

Lessons learned in designing AI for autistic adults: Designing the video calling for autism prototype

Andrew Begel, Microsoft Research
John Tang, Microsoft Research
Sean Andrist, Microsoft Research
Michael Barnett, Microsoft Research
Tony Carbary, Microsoft Research
Piali Choudhury, Microsoft
Edward Cutrell, Microsoft Research
Alberto Fung, University of Houston
Sasa Junuzovic, Microsoft Research
Daniel McDuff, Microsoft Research
Kael Rowan, Microsoft
Shibashankar Sahoo, UmeΠInstitute Of Design
Jennifer Frances Waldern, Microsoft
Jessica Wolk, Microsoft Research
Hui Zheng, George Mason University
Annuska Zolyomi, University of Washington

SoundWatch: Exploring smartwatch-based deep learning approaches to support sound awareness for deaf and hard of hearing users

Dhruv Jain, University of Washington
Hung Ngo, University of Washington
Pratyush Patel, University of Washington
Steven Goodman, University of Washington
Leah Findlater, University of Washington
Jon E. Froehlich, University of Washington

Living disability theory: Reflections on access, research, and design

Megan Hofmann, Carnegie Mellon University
Devva Kasnitz, Society for Disability Studies
Jennifer Mankoff, University of Washington
Cynthia L Bennett, Carnegie Mellon University

Navigating graduate school with a disability

Dhruv Jain, University of Washington
Venkatesh Potluri, University of Washington
Ather Sharif, University of Washington

Accepted posters

HoloSound: Combining speech and sound identification for Deaf or hard of hearing users on a head-mounted display

Ru Guo, University of Washington
Yiru Yang, University of Washington
Johnson Kuang, University of Washington
Xue Bin, University of Washington
Dhruv Jain, University of Washington
Steven Goodman, University of Washington
Leah Findlater, University of Washington
Jon E. Froehlich, University of Washington

#ActuallyAutistic Sense-making on Twitter

Annuska Zolyomi, University of Washington
Ridley Jones, University of Washington
Tomer Kaftan, University of Washington

Organizing Committee roles

Dhruv Jain as Posters & Demonstrations Co-Chair
Cynthia Bennett as Accessibility Co-Chair

Program committee roles

Cynthia Bennett (recent alumni, now at Apple/CMU) 
Leah Findlater
Jon Froehlich
Richard Ladner
Anne Ross

AccessComputing shares UW CREATE’s launch and work toward accessibility

AccessComputing | July 28, 2020

AccessComputing highlighted several research projects of UW CREATE faculty. An excerpt:

CREATE’s stated mission is “to make technology accessible and to make the world accessible through technology.” CREATE faculty pursue projects along both of these lines. Prof. [Jacob] Wobbrock was part of a team that helped make touch screens accessible by inventing Slide Rule, the world’s first finger-driven screen reader, in 2007. A research team including Profs. Richard Ladner, James Fogarty, and Wobbrock created GestureCalc, an eyes-free calculator for touch screens.

Prof. Jon Froehlich has created Project Sidewalk to use crowdsourcing and machine learning to gather and present outdoor navigation information, particularly the accessibility of sidewalks. Dr. Anat Caspi has a similar project called AccessMap, which provides personalized automated pedestrian routing.

Prof. Jennifer Mankoff conducts research on consumer-grade fabrication technology, such as low-cost 3D printing, and how this technology can be used to meet do-it-yourself or do-for-others accessibility challenges.

Professor Heather Feldner enables children with disabilities to explore the physical world through creative mobility support in her Go Baby Go project. [Kat Steele’s Open-Orthoses projects work with individuals with disabilities to co-design customized devices, rigorously test the devices, and provide open-source designs that accelerate development.]

For these and many other projects, CREATE faculty are already internationally recognized for their contributions to assistive technology and accessible computing; by bringing them together under one organizational roof, CREATE will enable synergies and foster collaborations that enable faculty and students to become more than the sum of their parts.

Read the full article

Microsoft invests $2.5M in CREATE, a new center for accessible tech at the University of Washington

GeekWire | May 28, 2020

Microsoft and the UW have long been aligned in a shared commitment to accessible technology and a world that is more accessible through technology. With a leadership team from six campus departments in three different colleges, CREATE will build upon the UW’s existing work in education, research and translation.

Read the full GeekWire article.

Four CREATE faculty receive Google Research Awards

UW News | March 16, 2020

Four UW CREATE faculty have been named recipients of Google Faculty Research Awards. The grants, among 150 Google recently announced, support world-class technical research in computer science, engineering and related fields. Each award provides funding to support one graduate student for a year.

The recipients are Jennifer Mankoff, James Fogarty and Jon Froelich of the Paul G. Allen School of Computer Science & Engineering and Leah Findlater of the Department of Human Centered Design & Engineering.

The goal of the awards is “to identify and strengthen long-term collaborative relationships with faculty working on problems that will impact how future generations use technology,” according to Google.