Last updated: 11/04/2006
Personal Information
Addresses
Present
James R. Lewis
7329 Serrano Terrace
Delray Beach, FL 33446
(561) 495-9033
drjimnfl@adelphia.net
Permanent
Same
Business
International Business Machines Corp.
Senior Human Factors Engineer
8051 Congress Avenue, Suite 2227
Boca Raton, FL 33487
Phone: (561) 862-2316
Fax: (561) 862-2988
E-mail: jimlewis@us.ibm.com
Other Personal Information
Birthplace: Alamogordo, NM
Birth Date: February 17, 1953
Marital Status: Married
No. of Children: Two
Height: 5' 9"
Weight: 200 lb
Health: Very good
Educational Information
Degree: Ph.D.
Date: September 1993 - December 1996
Major: Experimental Psychology
Minor: Cognitive Psychology (Psycholinguistics)
Institution: Florida Atlantic University
Location: Boca Raton, FL
Notes: GPA=3.9
Degree: None - Two semesters doctoral level
Date: September 1988 - May 1989
Major: Educational Psychology
Minor: Measurement and Statistics
Institution: Columbia University/Teacher's College
Location: New York, NY
Notes: GPA=4.0 for 15 semester hours
Degree: MA
Date: January 1982
Major: Experimental Psychology
Minor: Applied Statistics
Institution: New Mexico State University
Location: Las Cruces, NM
Notes: GPA=4.0 for 53 semester hours
Degree: BA
Date: August 1978
Major: Psychology
Institution: New Mexico State University
Location: Las Cruces, NM
Notes: Cumulative GPA=3.94, Graduated with honors
Degree: MM
Date: May 1978
Major: Music Theory and Composition
Minor: Keyboards
Institution: New Mexico State University
Location: Las Cruces, NM
Notes: GPA=3.84, First NMSU student to produce computer music
Degree: BM
Date: May 1975
Major: Music Theory and Composition
Minor: Piano
Institution: New Mexico State University
Location: Las Cruces, NM
Notes: GPA=3.95, graduated with highest honors, first NMSU student to produce
electronic music
Degree: High School Diploma
Date: May 1971
Institution: Alamogordo High School
Location: Alamogordo, NM
Notes: GPA=3.71, graduated 5th in a class of 512
Other Training
2002: "Quantitative Approaches to Human Factors and Usability Analysis",
workshop given by George K. Boggs of Ixian Technologies, Inc. at the 46th Annual Meeting of the
Human Factors and Ergonomics Society, Baltimore, MD
2001: "Tailoring Speech Recognition to Application Needs",
workshop given by Thomas Wetter of the University of Heidelberg at
HCI International 2001, New Orleans, LA
2000: "Secrets and Tools for Designing Effective IVR",
workshop given by Enterprise Integration Group, Orlando, FL
1999: "Measuring the Effect of In-Vehicle Information Systems on Driver Behavior",
workshop at Human Factors and Ergonomics Society Annual Meeting, Houston, TX
1995: Attended American Taekwondo Association camp for certified instructors -
3-day duration - renewed certification
1991: "Multiple Criteria Optimization", 4-day class taught by University Associates
of Princeton (R. Steuer)
1990: "Hierarchy and Prioritization Tool", 1-day class at IBM
1990: "Quality Function Deployment", 3-day class at IBM
1989: "Intermediate Psychometric Theory", 3-credit course at Columbia University,
Spring Semester, Grade: P
1989: "Multivariate Analysis II", 3-credit course at Columbia University,
Spring Semester, Grade: A
1988: "Multivariate Analysis I", 3-credit course at Columbia University,
Fall Semester, Grade: A
1988: "Computers and Cognition: Prolog Lab", 3-credit course at Columbia University,
Fall Semester, Grade: A
1988: "Computers and Cognition", 3-credit course at Columbia University,
Fall Semester, Grade: A
1987: "Artificial Intelligence", 1 week IBM course
1987: First Aid and CPR certification renewal
1986: "State of the Practice of Expert Systems Interfaces", workshop at
Human Factors Annual Meeting, Dayton, OH
1986: "Forensic Human Factors", workshop at Human Factors Annual Meeting,
Dayton, OH
1986: "Computer Science Fundamentals 3: Data Structures", 1 week IBM course
1986: "Computer Science Fundamentals 2: Control Structures", 1 week IBM course
1986: "Computer Science Fundamentals 1: Discrete Mathematics", 1 week IBM course
1986: Attended American Taekwondo Association camp for certified instructors -
1 week duration - renewed certification
1986: "Programming Fundamentals", IBM independent study course
1986: "Introduction to Computer Systems", IBM independent study course
1986: CPR certification renewal
1985: "Artificial Intelligence", workshop at Human Factors Society Annual Meeting,
Baltimore, MD
1985: "Cognitive Modeling: Applications to Interface Design, Artificial Intelligence,
and Computer- Aided Instruction", workshop at Human Factors Society Annual Meeting,
Baltimore, MD
1985: Attended American Taekwondo Association camp for trainee instructors -
1 week duration - received certification
1984: "How to Synthesize and Evaluate Performance Measures", workshop at
Human Factors Society Annual Meeting, San Antonio, TX
1984: "Design of Office Systems", workshop at Human Factors Society Annual Meeting,
San Antonio, TX
1984: First Aid and CPR certification
1983: "Event-related Brain Potentials and Human Engineering," .3 Continuing Education
Units, Old Dominion University
1983: "Writing User-Friendly Instructions", .3 Continuing Education Units,
Old Dominion University
1983: "Human Factors Engineering Advanced Concepts", 4 Continuing Education Units,
University of Michigan
1983: "Design of Experiments", 1 week IBM course
1982: "PM2: Project Management", 3 day IBM course
1982: "PM1: Project Management", 2 day IBM course
1982: "Questionnaires: Design, Uses, and Data Analysis", .3 Continuing Education Units,
California State University, Northridge
1982: "Computer Packages for Human Factors Data Analysis", .3 Continuing Education
Units, California State University, Northridge
1982: "Lab Services", 2 day IBM course
1982: "Boca Product Cycle", 4 day IBM course
1982: "SAS Graphics", 1 week IBM course
1982: "Perspectives 82", 1 week IBM course
1981: "Systems for Enhancing Human Information Exchange", 3 week course, IBM Systems
Research Institute
Employment
2001-Present
Position: Advisory/Senior Human Factors Engineer
Employer: International Business Machines Corp.
Project(s): IBM Voice Products -- Customer Focus
Location: West Palm Beach and Boca Raton, FL
Scope and Influence
Jim has led the user interface design of products for numerous high-profile customers (including Nextel, AAA, Philips, Thomson, and Hertz), based on
thorough user research and collaborations with those customers. He has used his deep understanding of customer needs to drive speech
development activities, and has used his deep knowledge of speech technologies and user interface design to craft compelling solutions
that delight our customers. Jim receives many requests every year to review SUI designs for customer applications, with those requests
coming from both domestic and international sources, within and across IBM divisions. Jim’s work has spanned many industries,
including telematics, entertainment, travel, financial services, energy, telco, road service, and consumer electronics.
Impact to IBM
Jim’s work has resulted in the delivery of voice applications that satisfy the complex, multiple objectives of our customers,
their users, and IBM. High customer satisfaction has resulted in significant repeat business from our clients.
The Nextel applications received JD Powers Best Telco rating.
Key Activities
IBM’s strategy for integrating its speech technology into the enterprise space has been strongly influenced through the involvement
of Voice Services engagements. Jim has been involved in this effort since its inception. He has been the lead HF designer of voice
applications developed for high profile IBM customers, ensuring that designs reflect the unique business needs of each customer, are
consistent with industry best practices, and result in high customer and end user satisfaction. Jim’s contribution to the services
teams he works with include a very broad range of activities used to implement a user centered approach to application development,
as well as the detailed design of every aspect of the user interface. The activities often start with educating IBM’s customers on the
importance of a user centered approach to voice application development, gathering customer requirements and the design and presentation
of vision clips. This is followed by the activities required to implement a high quality speech application – call flow design,
script writing, early low-fidelity prototyping using paper methods or VoiceXML coding, complex grammar coding, voice talent coaching,
audio post-production to ensure appropriate system timing, and usability testing. Note: In 2006, Jim joined IBM Services full time in the
Conversational Speech Solutions department. He continues to advise IBM product development on the design of future products, but his primary
focus is on customer engagements.
2000-2005
Position: Advisory/Senior Human Factors Engineer
Employer: International Business Machines Corp.
Project(s): IBM Voice Products -- End User Focus
Location: West Palm Beach and Boca Raton, FL
Scope and Influence
As the Human Factors (HF) lead for all Voice Middleware development and through his patenting and publishing activities,
Jim is well known internationally as an expert in Speech User Interface (SUI) Design and core speech technologies.
He has 40 US speech patents granted to date, 35 pending, and more on the way. Through his writing, teaching, and development activities,
his influence crosses site and divisional boundaries. Jim received an Execute Now! Division Award for his HF leadership on the
first product release of WebSphere Voice Application Access (WVAA).
Impact to IBM
Through Jim’s efforts and within the constraints of conforming to the W3C standards, IBM has incorporated best SUI design practices
into the fundamental architecture of speech browsers, and has validated the accuracy of our built-in data types. The continuously
updated SUI design best practices plus training materials are assets available for immersing developers in good SUI design.
Jim’s SUI design expertise has influenced the requirements for the voice application development tools (see section on
Developer Focus below).
Impact to Field of Human Factors
Publication of the MOS-X (a psychometrically validated method for measuring user response to artificial text-to-speech (TTS) voices)
in The Journal of Speech Technology. External conference publication of discoveries in the appropriate timing for the presentation of
global commands.
Key Activities
Jim’s work in this area began with the first release of WebSphere Voice Server (WVS), and has included all WVS releases, WVAA, and
Natural Language Understanding (NLU). He wrote the first chapter in IBM’s VoiceXML Programmer’s Guide in 2000, based on literature
reviews and coordinating inputs across disciplines and divisions. The chapter has been updated for each subsequent release of WVS,
based on the results of Jim’s empirical investigations of many specific UI component designs, and his SUI design and evaluation of many
voice applications written and deployed for large IBM customers (see section on Customer Focus below).
Jim has contributed consistently to the improvement of IBM’s core speech technologies through the application of expertly
designed Human Factors engineering experiments and methodologies. He conducted a large series of experiments to develop and tune
IBM’s VoiceXML built-in grammar types, coordinating work between research and development, leading to improved speech recognition
for applications written on our platform. Jim has also conducted numerous user listening studies (lab and web-based) to evaluate
IBM and competitor’s Text-to-speech (TTS) technologies. In order to systematize this effort, he developed a new rating method (MOS-X)
and continues to improve on that method as more information on the human interaction with synthetic speech is required. Jim is often
asked to consult in the design of experiments and statistical analysis of core embedded speech technologies as well.
2001-2005
Position: Advisory/Senior Human Factors Engineer
Employer: International Business Machines Corp.
Project(s): IBM Voice Products -- Developer Focus
Location: West Palm Beach and Boca Raton, FL
Scope and Influence
Jim is well known throughout IBM as an expert in the voice application development process and the tools required for the rapid and
efficient production of well designed applications. Jim has been the HF lead for all aspects and all releases of IBM's Voice Toolkit,
including standard VoiceXML, WVAA, and Natural Language Understanding (NLU) tooling. Jim’s consistent focus on the application developer
user experience contributed to the evolution of the voice tooling from a text based set of tools to graphical based tooling. Jim played a
key role in moving the Graphical Call Flow Builder from a VoiceXML-centric design, to one that requires no knowledge of VoiceXML. This
evolution began with the VoiceXML tools, and extended the application of graphical tooling concepts to grammar building and NLU call
routing applications. These innovations have lowered the skills and experience required to develop speech applications, a primary
marketing requirement. Jim developed a 5-day SUI design class that includes both lecture and labs. By invitation, he has taught the class
to IBM and Business Partner developers in Japan, China, and England.
Impact to IBM
Jim’s efforts have produced highly usable tools to support rapid IBM and customer production of VoiceXML code and associated
development activities (e.g., rapid production of placeholder audio, grammar testing, working with pronunciations). The graphical tools
were favorably reviewed in Speech Technology Magazine. Favorable responses have been received from developers such as Karl Roberts
(Digital Union, an IBM business partner): Regarding Voice Toolkit documentation and ease of use – “I've spent a lot of time looking
[for VXML best practices info], and I've found the documentation that comes with the IBM VoiceServer SDK (free) really good. I'm not sure
you can download it separate, but it's not just VXML tags in there. It goes into structure, timing, best practice, what to avoid etc.
The IBM Voice Toolkit (separate prod and free) makes building voice apps really easy and with components your apps are really modularized
and structured. The kit is really good, in 7 minutes you can be up and running with your first app.”
Key Activities
Each version of the toolkit has benefited from the results of usability evaluations designed and conducted by Jim, and
market research activities he has participated in (surveys, focus groups, and competitive analysis). Jim consults with the programmers
developing all voice tools with a user interface. Jim wrote the first version of the Getting Started Guide delivered to drive the
end-to-end scenario based development with the toolkit. He keeps the guide current to reflect improvements and enhancements to the
end-to-end scenario. He has also written tutorials teaching how to code VoiceXML prototypes that embody the Human Factors best practices
developed through his work with the consumers (end users) of speech applications, and how to write a natural commands shell around a
directed dialog application.
2005
Position: Advisory/Senior Human Factors Engineer
Employer: International Business Machines Corp.
Project(s): IBM Voice Products -- Administrator Focus
Location: West Palm Beach and Boca Raton, FL
Scope and Influence
In 2005 Jim extended his user interface work to include a focus on voice server installation and administration.
Impact to IBM
Improved usability and consumability of WVS products.
1998-Present
Position: Advisory/Senior Human Factors Engineer
Employer: International Business Machines Corp.
Project(s): Corporate UCD/UX Advisory Council
Location: West Palm Beach and Boca Raton, FL
Scope and Influence
Before joining the UCD/UX Advisory Council, Jim had already established himself internationally as an expert in usability methods and metrics.
Jim’s externally published work on usability satisfaction measurement has been referenced and endorsed in national and international usability standards.
His position on the UCD/UX council has allowed him to extend his influence to an even greater extent within and outside of IBM. Jim is the current chair
of the workgroup on usability metrics run under the auspices of the US National Institute of Standards and Technology. He has played a key role in past
council activities to work out UCD/UX development processes, and led the development of website training materials for the estimation of sample size
requirements for all types of usability studies. In 2001, Jim received one of the first UCD Team Awards for this effort. He is currently the SWG
representative on the integration of UCD/UX into OID processes, and was recently invited to lead the work on IBM’s corporate user guidelines for web
application design. Jim receives many invitations every year from external groups to publish papers, join editorial review boards, participate in
conference program committees, chair conference sessions, review book proposals, and to review draft standards. Most recently, he has co-written a
chapter on sample size estimation for the International Encyclopedia of Ergonomics and Human Factors with Carl Turner (State Farm) and the internationally
renowned usability guru, Jakob Nielsen (Nielsen-Norman Group).
Impact to IBM
Corporate leadership with statistically sophisticated UCD/UX methods.
Impact to Field of Human Factors
Published breakthrough research in sample size estimation for problem-discovery usability studies in 2001 and enhancements to usability satisfaction
measurement in 2002. Received invitation to write chapter on Usability Testing for the 3rd edition of the Handbook of Human Factors and Ergonomics
(most prestigious handbook in the field) – the chapter has been written and will be published in 2006.
1998-2001
Position: Advisory Human Factors Engineer
Employer: International Business Machines Corp.
Project(s): TransNote/ThinkScribe, CrossPad2, Ink Manager 2.0, and Ink Manager Pro 2.0
Location: West Palm Beach and Boca Raton, FL
Scope and Influence
Jim was the lead HF engineer for development and evaluation of CrossPad2 digital ink capture system and Ink Manager (IM) 2.0 digital ink recognition and
management software - a cross-site, cross divisional project. Based on the reputation Jim gained in that development activity, he was invited to lead the
cross-divisional multi-site HF engineering for the transition of CrossPad technologies and software to the TransNote with ThinkScribe (including Ink Manager
Pro 2.0) -- a ThinkPad that was a combination of an ultra-portable and a CrossPad.
Impact to IBM
For the CrossPad2, IBM delivered to Cross Corp. a unique, highly usable device and associated software. The TransNote/ThinkScribe received
significant recognition upon its release, including “The Best Product of the Year” from Business Week and a “Technical Excellence Award” from
PC Magazine.
Impact to Field of Human Factors
Published information on the selection accuracy of the CrossPad2 and ThinkScribe innovative selection slots -- a new type of selection control for
pen/stylus computers.
1997-2000
Position: Advisory Human Factors Engineer
Employer: International Business Machines Corp.
Project(s): IBM Dictation Products (VoiceType Dictation, ViaVoice)
Location: Boca Raton and West Palm Beach, FL
Scope and Influence
Jim provided HF design guidance to every version of Voice Type Dictation and ViaVoice. This required close collaboration with Development
and Research (a cross-divisional effort) throughout the development of these products.
Impact to IBM
Results of HF work provided design guidance to every version of Voice Type Dictation and ViaVoice. The ViaVoice desktop product held its own
against very tough competition (Dragon and L&H), and is still being sold through ScanSoft, winning industry awards such as MacWorld Best of Show in 2001
and Speech Technology Magazine Best ASR Solution/Desktop in 2002.
Impact to Field of Human Factors
Published model of dictation throughput and experiments measuring the effect of automatic document analysis on recognition accuracy.
Session chair and invited presenter of two papers at International Conference on Applied Ergonomics ‘96 in Turkey.
Presented doctoral research at CUNY conferences on human sentence processing in 1995, 1996 and 1997. Presented invited paper at HCI ’99.
Presented six papers at HFES ’99.
1994-1996
Position: Advisory Human Factors Engineer
Employer: International Business Machines Corp.
Project(s): The Human Center
Location: Boca Raton and West Palm Beach, FL
Scope and Influence
Lead HF designer for the HC Markup application, which was part of the Human Center -- a project capitalizing on IBM's speech recognition and artificial
voice production technologies, thus requiring cross-divisional coordination with IBM Research.
Impact to IBM
Although never released as a commercial product, the Human Center project (including HC Markup) provided the developer experience needed to
successfully commercialize IBM's speech technologies in later products such as dictation systems and voice servers.
1993-1994
Position: Advisory Human Factors Engineer
Employer: International Business Machines Corp.
Project(s): Simon Personal Communicator
Location: Boca Raton and West Palm Beach, FL
Scope and Influence
Based on Jim’s company-wide reputation as an expert in UI designs for touchscreens and design for usability,
he was invited to join the development of Simon – the first cellular-phone based personal communicator.
IBM and BellSouth collaborated on Simon (designed by IBM with a BellSouth logo). As the lead HF designer in a small IBM development group
led by Frank Canova, Jim had total control over the external design of resident software PIM applications and significant influence on the
hardware design.
Impact to IBM
IBM received industry acclaim for this visionary, award-winning, highly usable product.
Industry awards included Best of Show at Comdex 1993, 1994 Popular Science Best of What's New award, Grand Winner of the 1994 MAX award,
and the 1995 Byte Magazine Award of Distinction. Journalists had high praise for the product’s ease of use, such as:
- “It looks and feels like a product you already know how to use, rather than a new religion you must immerse yourself in.” (O’Malley, Byte, 1994)
- “I hope that Simon is the first in a long series of personal communications tools, but even as a first generation product,
Simon is a joy to use.” (Nelson, PDA Developer, 1995)
- “Simon is not the first personal communicator product I’ve demoed, but it is by far the most comprehensive, well-designed, and easiest to use.”
(Carter-Lome, Cellular Marketing, 1994)
Impact to Field of HF Engineering
Iterative design and evaluation of the first personal communicator, a product now recognized in the industry to have been years ahead of its time.
Presented paper at Human-Computer Interaction International '93.
Key Activities
HF design lead for all aspects of the Simon Personal Communicator (hardware and software), from underlying architectural considerations that enabled
the highly usable touchscreen to the design of all resident PIM applications. Strong application of up-front usability methods, including literature
reviews; scenario based design and test; and comprehensive task analysis and low-fidelity application prototyping.
1990-1992
Position: Advisory Human Factors Engineer
Employer: International Business Machines Corp.
Project(s): PS/2 Models 90/95, PS/2 Model 57, ThinkPad 700 and 750
Location: Boca Raton, FL
Responsibilities
Consulted with engineers and programmers regarding IBM PS/2 computer product designs - designed, conducted,
and analyzed experiments to resolve product design issues - presented results to upper
management - made significant contributions to body of human factors knowledge - wrote
computer programs as required for data collection and analysis - continued to conduct research
in the measurement of product usability - technical lead for six-member usability team.
Scope and Influence
For the ThinkPad 700C, Jim brought together the IBM Research team developing the pointing stick (i.e., TrackPoint) and the Personal Systems
team developing the ThinkPad 700C laptop computer. He overcame strong Development opposition to the TrackPoint at the eleventh hour
(primarily due to concerns about its impact on keyboard manufacturing cost, but also concerns from the Yamato HF lab regarding its immediate usability)
to bring the device to market.
Jim led the HF activities for IBM's first multimedia computer (PS/2 Model 57 Ultimedia). He conducted early customer interviewing as the HF
leader for IBM’s first attempt to gather Quality Functional Deployment measurements, used to focus customer requirements. Findings from usability
testing influenced manufacturing line processes regarding treatment of external multimedia controls. Received usability leadership award.
Jim also led the hardware HF evaluation activities for IBM’s first tablet computer, the ThinkPad 750C, and a similar special-bid tablet
computer designed for long-haul truck drivers.
Upon his return to Boca from Research, Jim led the HF activities in the development of the PS/2 Models 90 and 95.
He received an ESD Division Award for usability leadership in this project.
Impact to IBM
The TrackPoint is widely considered one of the most important IBM innovations in the ThinkPad product line, contributing to the hundreds of
design awards received by the ThinkPad from its first release in 1992 to the present, including the PC Magazine Technical Excellence award in 1993.
The experience gained with the tablet computers paved the way to later design success with the development of the Simon and ThinkScribe products.
The PS/2 Models 90/95 had superior HF engineering of components (display, keyboard, and mouse) and documentation.
Information Development adopted the strategy Jim recommended of reducing the cloudiness count (an automated readability measure),
which resulted in a Model 95 cloudiness of 5.6 and Model 90 cloudiness of 4.3 – a substantial drop from the Model 55 cloudiness of 9.5.
This contributed to (1) an Infoworld rating of excellent for the new publications, a 4-point jump from previous ratings of poor,
(2) a 1992 Society for Technical Communications award, and (3) the IBM Atlanta HelpCenter reported an 80% drop in customer calls about publications.
Impact to Field of Human Factors
Iterative design and validation of the TrackPoint -- a completely new pointing device.
Publication of innovative soft keyboard layouts for stylus-based user interfaces.
Discovery and validation of the utility of the cloudiness count for the competitive evaluation of user documentation.
Made presentations at 1990-1992 Human Factors Society Annual Meetings and 1990-1991 CHI conferences.
Received Society for Technical Communications awards in 1991 (Distinguished) and 1992 (Merit).
1988-1989
Position: Staff Human Factors Engineer
Employer: International Business Machines Corp.
Project(s): Temporary Research Assignment
Location: IBM T.J. Watson Research Center, Hawthorne, NY
Responsibilities
Conducted research in the measurement of computer system usability, with special emphasis on competitive evaluation.
Scope and Influence
Based on Jim’s growing reputation as an expert in usability methods and metrics, he received a one-year temporary assignment to work in the
Human-Computer Interaction lab at the TJ Watson Research Center in Hawthorne. While there, he conducted seminal research that advanced the
techniques of usability engineering (a Research Division activity) and, at the same time, had a major effect on the OS/2 office application
development effort in the Application Systems Division (for which he received an Application Systems Division award).
Impact to IBM
Competitive information about strengths and weaknesses of the current IBM solution (PROFS), the Mac solution, and the Windows solution
provided significant input to the design of the OS/2 solution.
Impact to Field of Human Factors Engineering
The basic work on usability measurement and problem discovery that Jim conducted during this temporary assignment led to papers published in the early
1990s that continue to be frequently cited -- specifically, Lewis (1994) -- a paper problem discovery sample size estimation and Lewis (1995) -- a paper
on the psychometric qualification of various user satisfaction instruments developed during this project. Note that the questionnaires from Lewis (1995)
developed during this project (the PSSUQ, CSUQ, and ASQ) have been endorsed for use in the applicable ANSI and ISO usability standards. These are the
papers that established Jim’s international reputation as an expert in quantitative usability methods. During this time period, Jim presented research
papers at Interface '89, HFES '89, and at the Hawaii International Conference on System Sciences.
1987-1988
Position: Staff Human Factors Engineer
Employer: International Business Machines Corp.
Project(s): Business Planning
Location: Boca Raton, FL
Responsibilities
Maintained business plan databases and produced database reports - conducted headcount and
business cost estimates - analyzed business processes - presented results to upper management -
wrote computer programs as required for data collection and analysis.
Scope and Influence
Took assignment to learn more about business processes. Studied ESD business planning processes and developed/coded applications (PlanBuilder) to
improve the data collection and roll-up processes. Received IBM Spotlight Award for this effort.
Impact to IBM
The PlanBuilder tool greatly improved the efficiency and accuracy of the data collected in support of ESD business planning.
Key Activities
Worked with senior business planners to collect and combine data for Entry Systems Division (ESD -- PS/2 PCs) semi-annual business plans.
Developed requirements for and programmed tools to collect data from managers and rolling it up into the form needed by the area business planners.
Applied HF principles in the development and assessment of the effectiveness of the tool (PlanBuilder).
Boca Raton site representative for Reliability and Applied Statistics Interdivisional Technical Liaison.
Published research paper in Human Factors journal.
1983-1987
Position: Senior Associate/Staff Human Factors Engineer
Employer: International Business Machines Corp.
Project(s): PC Printers, PC Input Devices for Entry Systems Division (ESD)
Location: Boca Raton, FL
Responsibilities
Consulted with engineers regarding computer product designs - designed, conducted, and analyzed
experiments to resolve product design issues.
Scope and Influence
Jim was with IBM just as the PC business took off. From the beginning, he played several key roles, specializing in the design and evaluation of PC
input devices and developing innovative usability evaluation metrics to advance the state of the art in usability evaluation.
The key areas in which Jim provided early leadership to the design of PC components were:
- ESD representative to IBM-wide corporate task force to develop converged keyboard (a single keyboard design that would work
for all IBM systems -- personal computers, mainframe terminals, etc.). Had particular influence in the final design of the converged keyboards Backspace
and Enter keys – designs that are still used in IBM keyboards, which are widely regarded as the best in the world.
- ESD representative to corporate task force to develop standard symbol evaluation methodology. Led development and validation of standard method.
- Served in inter-divisional task force for color coding standards for indicators and controls.
- Collaborated with Industrial Design department in the design and evaluation of the PS/2 mouse. Worked with early DOS Graphical User Interface (GUI)
shell (pre-Windows) to compare usability of mice and touchpads.
Impact to IBM
The final converged keyboard design based on HF best practices and experimentation (both lab and field), produced an extremely successful design that
has stood the test of time for over 20 years. The PS/2 mouse design, also based on HF best practices and experimentation, was a successful design
that remained in use throughout the PS/2 product line. Jim’s analyses of mouse usage drove IBM mouse design to two buttons
(over the competing designs with one or three buttons) -- a result that still holds in current mouse designs across the industry. Taught IBM courses
in screen formatting and experimental design.
Impact to Field of HF Engineering
Published and presented at all HFES annual meetings from 1983-1986. Published (internal to IBM) standardized symbol evaluation method.
Published earliest known use of external usability instrumentation to enable data-driven design for usability of keyboards in field settings.
Published paper about mouse design and evaluation.
Published innovative use of rank metrics to create combined usability measures capable of dealing with different types of missing data.
Published innovative experimental design methods for within-subjects experiments (digram-balanced Greco-Latin squares).
1981-1983
Position: Associate Human Factors Engineer
Employer: International Business Machines Corp.
Project(s): System/23
Location: Boca Raton, FL
Responsibilities
Helped more experienced human factors engineers to consult with Development regarding computer product designs,
helped conduct and analyze usability studies of computer products.
Scope and Influence
This was Jim’s first project at IBM. He worked under the direction of more senior HF engineers to evaluate
customer setup for the System/23 DataMaster.
Impact to IBM
Successful CSU design for key pre-Personal Computer (PC) product --
lessons learned, documented in guidelines for CSU, carried over to later PC designs.
Impact to Field of Human Factors Engineering
Earliest known use of cumulative binomial probability formula to model usability problem discovery rate and sample size estimation --
work published externally in 1982 at HFES conference.
Part Time
1979-1980
Position: Graduate Assistant
Employer: New Mexico State University Psychology Dept.
Location: Las Cruces, NM
Responsibilities
Teaching assistant for instructors -lab assistant for undergraduate introductory classes -
research assistant to Dr. Darwin P. Hunt
Accomplishments
Developed undergraduate lab materials - conducted research in mathematical modeling of
galvanic skin response and human self-assessment of knowledge
1978-1980
Position: Night Supervisor
Employer: New Mexico State University Library
Location: Las Cruces, NM
Responsibilities
Manage student workers at Serials Desk
1978
Position: Freelance Music Arranger
Employer: Self
Location: Las Cruces, NM
Responsibilities
Provide expertise in music theory and arrangement to others
Accomplishments
Arranged orchestral and piano scores for Beaucatcher Hill for Alamogordo Music Theater -
production of copy-ready music manuscript for Dr. Donald Hardisty
1978
Position: Assistant Instructor
Employer: New Mexico State University Music Department
Location: Las Cruces, NM
Responsibilities
Assist Dr. Warner Hutchison in teaching class on electronic and computer music
1972-1975 (excepting summers)
Position: Shelver
Employer: New Mexico State University Library
Location: Las Cruces, NM
Responsibilities
Replace books into stacks - maintain order in study areas
1969-1971
Position: Student Assistant
Employer: Alamogordo Public Library
Location: Alamogordo, NM
Responsibilities
Check out library materials - replace books into stacks - maintain order in study areas
Other Employment
Summer 1979: Statistics tutor to minority students at New Mexico State University
Summer 1976: Music librarian at New Mexico State University
Summer 1975: Summer hire at Holloman Air Force Base recreation center
Summer 1974: Painted dormitories at the New Mexico State School for the Visually Handicapped
Summer 1973: Summer hire at Holloman Air Force Base airmen's club
Summer 1972: Maintenance at Alamogordo Public Library
Certification or License Status
Certified Human Factors Professional by the Board of Certification in Professional Ergonomics (#131)
Nationally certified taekwondo instructor with the American Taekwondo Association
Certified scuba diver with NAUI
Professional Activities
Human Factors and Ergonomics Society (HFES)
American Psychological Society (APS)
Usability Professionals Association (UPA)
ACM Special Interest Group in Computer-Human Interaction (SIGCHI)
Applied Voice Input/Output Society (AVIOS)
Elected Positions
Appointed Positions
2005-Present: Editorial board of the Journal of Usability Studies
2004-Present: Chair of Formative Usability Testing Metrics Workgroup for National Institute of Standards and Technology (NIST)
2004-Present: Scientific advisory board of The Center for Research & Education on Aging & Technology Enhancement (CREATE)
2002-Present: Editorial board of The International Journal of Human-Computer Interaction
1984-1988, 1995 to present: Assistant instructor at Boca Raton ATA Taekwondo Club
1990-1995: Assistant instructor at Margate ATA Taekwondo
Creative Professional Activities
Publications and Presentations
Books and Book Chapters
Lewis, J. R.. (2006). Usability testing. In G. Salvendy (Ed.), Handbook of Human Factors and Ergonomics
(pp. 1275-1316). New York, NY: John Wiley.
Turner, C. W., Lewis, J. R., and Nielsen, J. (2006).
Determining usability test sample size.
In W. Karwowski (Ed.), International Encyclopedia of Ergonomics and Human Factors
(pp. 3084-3088). Boca Raton, FL: CRC Press.
Lewis, J. R., Potosnak, K. M., and Magyar, R. L. (1997).
Keys and keyboards.
In M. Helandar, T. K. Landauer, and P. Prabhu (Eds.), Handbook of Human-Computer Interaction
(pp. 1285-1315). Amsterdam: Elsevier.
Articles in Refereed Journals
Lewis, J. R., and Sauro, J. (2006).
When 100% really isn’t 100%: Improving the accuracy of small-sample estimates of completion rates.
Journal of Usability Studies, 3, 136-150.
Commarford, P. M., and Lewis, J. R. (2004).
Models of throughput rates for dictation and voice spelling for handheld devices.
International Journal of Speech Technology, 7, 69-79.
Lewis, J. R. (2004).
Evaluating the potential effectiveness of automatic document analysis.
International Journal of Speech Technology, 7, 35-43.
Lewis, J. R., and Commarford, P. M. (2003).
Developing a voicespelling alphabet for PDAs.
IBM Systems Journal, 42, 624-638.
Polkosky, M. D., and Lewis, J. R. (2003).
Expanding the MOS: Development and psychometric evaluation of the MOS-R and MOS-X.
International Journal of Speech Technology, 6, 161-182.
Lewis, J. R. (2002).
Psychometric evaluation of the PSSUQ using data from five years of usability studies.
International Journal of Human-Computer Interaction, 14, 463-488.
Polkosky, M. D., and Lewis, J. R. (2002).
Effect of auditory waiting cues on time estimation in speech recognition telephony applications.
International Journal of Human-Computer Interaction, 14, 423-446.
Lewis, J. R. (2001).
Evaluation of procedures for adjusting problem-discovery rates estimated from small samples.
International Journal of Human-Computer Interaction, 13, 445-479.
Lewis, J. R. (2001).
Introduction: Some current issues in usability evaluation.
International Journal of Human-Computer Interaction, 13, 343-349.
Milenkovic, M., Happ, A. J., and Lewis, J. R. (1997). Design decisions for a voice
navigation system. International Journal of Speech Technology, 2, 71-79.
Lewis, J. R. (1995).
IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use.
International Journal of Human-Computer Interaction, 7, 57-78.
Lewis, J. R. (1994).
Sample sizes for usability studies: Additional considerations.
Human Factors, 36, 368-378.
Lewis, J. R. (1993).
Multipoint scales: Mean and median differences and observed significance levels.
International Journal of Human-Computer Interaction, 5, 383-392.
Lewis, J. R. (1993).
Pairs of Latin squares that produce digram-balanced Greco-Latin
designs: A BASIC program. Behavior Research Methods, Instruments, & Computers,
25, 414-415.
Lewis, J. R. (1991).
An after- scenario questionnaire for computer usability studies: Psychometric Evaluation Over Three Trials.
SIGCHI Bulletin, 23 (4), 79.
Lewis, J. R. (1991).
Psychometric evaluation of an after- scenario questionnaire for computer usability studies: The ASQ.
SIGCHI Bulletin, 23 (1), 78-81.
Lewis, J. R. (1987).
Slot vs. insertion magnetic stripe readers: User performance and preference.
Human Factors, 29, 461-464.
Papers Included in Published Proceedings of a Meeting
Lewis, J. R. (2006). Effectiveness of various automated readability measures for the competitive evaluation of user documentation.
In Proceedings of the Human Factors and Ergonomics Society 50th Annual Meeting (pp. 624-628).
Santa Monica, CA: Human Factors and Ergonomics Society.
Lewis, J. R. (2006). Effect of level of problem description on problem discovery rates: Two case studies.
In Proceedings of the Human Factors and Ergonomics Society 50th Annual Meeting (pp. 2567-2571).
Santa Monica, CA: Human Factors and Ergonomics Society.
Kotan, C., and Lewis, J. R. (2006). Investigation of confirmation strategies for speech recognition applications.
In Proceedings of the Human Factors and Ergonomics Society 50th Annual Meeting (pp. 728-732).
Santa Monica, CA: Human Factors and Ergonomics Society.
Lewis, J. R., Commarford, P. M., and Kotan, C. (2006). Web-based comparison of two styles of auditory presentation: All TTS versus rapidly mixed TTS and recordings.
In Proceedings of the Human Factors and Ergonomics Society 50th Annual Meeting (pp. 723-727).
Santa Monica, CA: Human Factors and Ergonomics Society.
Sauro, J., and Lewis, J. R. (2005).
Estimating completion rates from small samples using binomial confidence intervals: Comparisons and recommendations.
In Proceedings of the Human Factors and Ergonomics Society 49th Annual Meeting (pp. 2100-2104).
Santa Monica, CA: Human Factors and Ergonomics Society.
Commarford, P. M., and Lewis, J. R. (2005).
Optimizing the pause length before presentation of global navigation commands.
In Proceedings of HCI International 2005: Volume 2 - The Management of Information: E-Business, the Web, and Mobile Computing
(pp. 1-7). St. Louis, MO: Mira Digital Publication
Lewis, J. R. (2005).
Accuracy error span evaluations: Implications for user interface design of speech dictation and handwriting recognition applications.
In Proceedings of HCI International 2005: Vol. 6 - Human Factors Issues in Human-Computer Interaction
(pp. 1-8). St. Louis, MO: Mira Digital Publication
Lewis, J. R. (2005).
Frequency distributions for names and unconstrained words associated with the letters of the English alphabet.
In Proceedings of HCI International 2005: Posters
(pp. 1-5). St. Louis, MO: Mira Digital Publication
Lewis, J. R. (2004).
Selection accuracy with pen selection slots.
In Proceedings of the Human Factors and Ergonomics Society 48th Annual Meeting
(pp. 783-787). Santa Monica, CA: Human Factors and Ergonomics Society.
Lewis, J. R. (2004).
Effect of speaker and sampling rate on MOS-X ratings of concatenative TTS voices.
In Proceedings of the Human Factors and Ergonomics Society 48th Annual Meeting
(pp. 759-763). Santa Monica, CA: Human Factors and Ergonomics Society.
Turner, C. W., Nielsen, J., and Lewis, J. R. (2002). Current issues in the determination of usability test sample size:
How many users is enough? In Proceedings of Usability Professionals Association UPA '02.
Download the associated J. Lewis Powerpoint presentation:
SAMSIZE-UPA02.PPT.
Lewis, J. R. (2001). Psychometric properties of the Mean Opinion Scale. In Proceedings of HCI
International 2001: Usability Evaluation and Interface Design (pp. 149-153). Mahwah, NJ: Lawrence Erlbaum.
Wang, H., and Lewis, J. R. (2001). Intelligibility and acceptability of short phrases generated by
embedded text-to-speech engines. In Proceedings of HCI International 2001: Usability Evaluation and
Interface Design (pp. 144-148). Mahwah, NJ: Lawrence Erlbaum.
Lewis, J. R. (1999). Effect of error correction strategy on speech dictation throughput.
In Proceedings of the Human Factors and Ergonomics Society 43rd Annual Meeting
(pp. 457-461). Santa Monica, CA: Human Factors and Ergonomics Society.
Lewis, J. R., LaLomia, M. J., and Kennedy, P. J. (1999). Evaluation of typing key layouts
for stylus input. In Proceedings of the Human Factors and Ergonomics Society 43rd Annual
Meeting (pp. 420-424). Santa Monica, CA: Human Factors and Ergonomics Society.
Lewis, J. R., Kennedy, P. J., and LaLomia, M. J., (1999). Development of a digram-based
typing key layout for single-finger/stylus input. In Proceedings of the Human Factors and
Ergonomics Society 43rd Annual Meeting (pp. 415-419). Santa Monica, CA: Human Factors and
Ergonomics Society.
Lewis, J. R. (1999). Input rates and user preference for three small-screen input methods:
Standard keyboard, predictive keyboard, and handwriting. In Proceedings of the Human
Factors and Ergonomics Society 43rd Annual Meeting (pp. 425-428). Santa Monica, CA:
Human Factors and Ergonomics Society.
Lewis, J. R., Allard, D. J., and Hudson, H. D. (1999). Predictive keyboard design study:
Effects of word populations, number of displayed letters, and number of transitional
probability tables. In Proceedings of the Human Factors and Ergonomics Society 43rd Annual
Meeting (pp. 429-432). Santa Monica, CA: Human Factors and Ergonomics Society.
Lewis, J. R. (1999). Information for PDA application design: Calendar entry and name
length statistics. In Proceedings of the Human Factors and Ergonomics Society 43rd Annual
Meeting (pp. 467-470). Santa Monica, CA: Human Factors and Ergonomics Society.
Lewis, J. R. (1999). Trade-offs in the design of the IBM computer usability satisfaction
questionnaires. In H. Bullinger and J. Ziegler (eds.)., Human-Computer Interaction:
Ergonomics and User Interfaces – Vol. I (pp. 1023-1027). Mahwah, NJ: Lawrence
Erlbaum.
Lewis, J. R. (1996). Binomial confidence intervals for small sample usability studies.
In G. Salvendy and A. Ozok (eds.), Advances in Applied Ergonomics: Proceedings of the 1st
International Conference on Applied Ergonomics -- ICAE '96 (pp. 732-737).
Istanbul, Turkey: USA Publishing.
Lewis, J. R. (1996). Reaping the benefits of modern usability evaluation: The Simon
story. In G. Salvendy and A. Ozok (eds.), Advances in Applied Ergonomics: Proceedings
of the 1st International Conference on Applied Ergonomics -- ICAE '96 (pp. 752-757).
Istanbul, Turkey: USA Publishing.
Lewis, J. R. (1993). Problem discovery in usability studies: A model based on the
binomial probability formula. In Proceedings of the Fifth International Conference on
Human-Computer Interaction (pp. 666-671). Orlando, FL: Elsevier.
Lewis, J. R. (1992). Psychometric evaluation of the post-study system usability
questionnaire: The PSSUQ. In Proceedings of the Human Factors Society 36th Annual
Meeting (pp. 1259-1263). Atlanta, GA: Human Factors Society.
Lewis, J. R. (1991). A rank-based method for the usability comparison of competing
products. In Proceedings of the Human Factors Society 35th Annual Meeting
(pp. 1312-1316). San Francisco, CA: Human Factors Society.
Loricchio, D. F. and Lewis, J. R. (1991). User assessment of standard and reduced-size
numeric keypads. In Proceedings of the Human Factors Society 35th Annual Meeting
(pp. 251-252). San Francisco, CA: Human Factors Society.
Lewis, J. R. (1990). The Iowa Silent Reading Test's reading comprehension section:
Local norms and predictive validity for usability studies. In Proceedings of the Human
Factors Society 34th Annual Meeting (pp. 922-926). Orlando, FL: Human Factors Society.
Lewis, J. R., Henry, S. C., and Mack, R. L. (1990). Integrated office software
benchmarks: A case study. In Human-Computer Interaction - INTERACT '90, Proceedings of
the Third IFIP Conference on Human-Computer Interaction (pp. 337-343). Cambridge,
England: Elsevier Science Publishers.
Lewis, J. R. (1989). Pairs of Latin squares to counterbalance sequential effects and
pairing of conditions and stimuli. In Proceedings of the Human Factors Society 33rd
Annual Meeting (pp. 1223-1227). Denver, CO: Human Factors Society.
Lewis, J. R. and Alfonso, P. (1989). Developing the IBM Personal System/2 mouse: An
industrial design/human factors collaboration. In Proceedings of the Sixth Symposium
on Human Factors and Industrial Design in Consumer Products - Interface 89 (pp. 263-267).
Pittsburgh, PA: Human Factors Society.
Kennedy, P. J., Lewis, J. R., and Alfonso, P. (1989). Industrial design and human
factors contributions to the design of IBM's PS/2. In Proceedings of the Sixth Symposium
on Human Factors and Industrial Design in Consumer Products - Interface 89 (pp. 221-224).
Pittsburgh, PA: Human Factors Society.
Snyder, K. M. and Lewis, J. R. (1989). Cognitive representations of DOS commands as a
function of expertise. In Proceedings of the 22nd Annual Hawaii International Conference
on System Science (pp. 447-456). Kailua-Kona, Hawaii: Computer Society of the IEEE.
Lewis, J. R. (1986). Power switches: Some user expectations and preferences. In
Proceedings of the Human Factors Society 30th Annual Meeting (pp. 895-899).
Dayton, OH: Human Factors Society.
Kennedy, P. J. and Lewis, J. R. (1985). A method of analyzing personal computer use in
an application environment. In Proceedings of the Human Factors Society 29th Annual
Meeting (pp. 1057-1060). Baltimore, MD: Human Factors Society.
Snyder, K. M., Happ, A. J., Malcus, L., Paap, K. R., and Lewis, J. R. (1985). Using
cognitive models to create menus. In Proceedings of the Human Factors Society 29th Annual
Meeting (pp. 655-658). Baltimore, MD: Human Factors Society.
Lewis, J. R. (1984). Association of visually coded functions with an alternate key.
In Proceedings of the Human Factors Society 28th Annual Meeting (pp. 973-976).
San Antonio, TX: Human Factors Society.
Kennedy, P. J. and Lewis, J. R. (1983). Automated data collection. In Proceedings
of the Human Factors Society 27th Annual Meeting (pp. 546-547). Norfolk, VA: Human
Factors Society.
Happ, A. J. and Lewis, J. R. (1983). The effect of screen boundary, familiarity, and
data type on user's decision to scroll or window. In Proceedings of the Human Factors
Society 27th Annual Meeting (pp. 512-515). Norfolk, VA: Human Factors Society.
Lewis, J. R. (1982). Testing small system customer set-up. In Proceedings of the
Human Factors Society 26th Annual Meeting (pp. 718-720). Dayton, OH: Human Factors
Society.
Presentations Made at an External Conference (No publication)
Lewis, J. R., Shapiro, L. P., Tuller, B., and Afton, R. (March 1997). Local contextual
impenetrability of lexical access and gap-filling. Presentation made as a poster session at
the CUNY97 Tenth Annual Conference on Human Sentence Processing, New York, NY.
Lewis, J. R., Shapiro, L. P., Afton, R., and Tuller, B. (March 1996). The magnitude of
cross-modal lexical priming as a function of the verb-object relationship in a sentence.
Presentation made as a poster session at the CUNY96 Ninth Annual Conference on Human Sentence
Processing, New York, NY.
Borsky, S., Lewis, J. R., and Shapiro, L. P. (March 1995). The effect of preposed
arguments on verb integration times during ongoing sentential analysis. Presentation made
as a poster session at the CUNY95 Eighth Annual Conference on Human Sentence Processing,
March 16-18, Tucson, AZ.
Lewis, J. R. (1991). An after-scenario questionnaire for usability studies: Psychometric
evaluation over three trials. Presentation made as a short paper at the CHI '91 conference,
New Orleans, LA.
Lewis, J. R. (1990). Psychometric evaluation of an after-scenario questionnaire for
computer usability studies: The ASQ. Presentation made as a poster session at the CHI '90
conference, Seattle, WA.
Technical Disclosures
Lewis, J. R., Agapi, C., Dames, D., Gomez, F., and Kobal, J.S. (2004). Graphical representation
of a complex portion of a grammar rule as an embedded sub-rule
(Disclosure No. BOC820040091). IBM Technical Disclosure Bulletin.
Lewis, J. R., and Kobal, J. S. (2004). Notification of delayed response from a speech recognition system
(Disclosure No. BOC820040087). IBM Technical Disclosure Bulletin.
Lewis, J. R., and Commarford, P. M. (2004). Word completion feature that recognizes implicit rejections
(Disclosure No. BOC820030224). IBM Technical Disclosure Bulletin.
Lewis, J. R., and Commarford, P. M. (2004). Estimating menu choice selection from
choices recorded in a single audio file
(Disclosure No. BOC820030223). IBM Technical Disclosure Bulletin.
Lewis, J. R., and Commarford, P. M. (2004). Feedback of single character input for password
entry by multi-tap or probabilistic input methods
(Disclosure No. BOC820030222). IBM Technical Disclosure Bulletin.
Lewis, J. R., Michelini, V. V., Agapi, C., Gomez, F., and Sullivan, S. C. (2003).
System and method for searching audio segments
(Disclosure No. BOC820030102). IBM Technical Disclosure Bulletin.
Lewis, J. R., and Sadowski, W. J. (2002). Error resistant method for DTMF key entry of
US state codes (Disclosure No. BOC820010100). IBM Technical Disclosure Bulletin.
Lewis, J. R., and Kist, T. (2001). Generating a grammar for calendar subjects from existing
calendar entries (Disclosure No. BOC820010018). IBM Technical Disclosure Bulletin.
Lewis, J. R., Polkosky, M. D., and De Armas, M. (2001). Interactive speech enrollment wizard
accessible to screen readers (Disclosure No. BOC820010016). IBM Technical Disclosure Bulletin.
Lewis, J. R., and Kist, T. (2001). Disambiguation of intended e-mail recipients
by contextual analysis of e-mail subject and body text (Disclosure No. BOC820010015).
IBM Technical Disclosure Bulletin.
Lewis, J. R. (2001). Improving recognition accuracy for spoken passwords
(Disclosure No. BOC820000043). IBM Technical Disclosure Bulletin.
Ballard, B. E., Lewis, J. R., and Ortega, K. A. (1999). Graphical user interface
indicating on-screen elements having associated speech commands (Disclosure No. BC8-97-0069).
IBM Technical Disclosure Bulletin.
Lewis, J. R., Ortega, K. A., Friedland, S. (1999). Marking locations in material dictated
into a speech recognition system (Disclosure No. BC8-98-0019). IBM Technical Disclosure
Bulletin.
Ballard, B. E., Hanson, G. R., and Lewis, J. R. (1999). Audio highlighting tool for
proofreading dictated text (Disclosure No. BC8-97-0014). IBM Technical Disclosure
Bulletin.
Lewis, J. R., Ortega, K. A., Van Buskirk, R. E., and Wang, H. (1999). Speech recognition
for multiple speakers in group settings (Disclosure No. BC8-98-0057). IBM Technical
Disclosure Bulletin.
Ballard, B. E., Lewis, J. R., and Ortega, K. A. (1999). Method for logging edits and
deferring corrections in a speech recognition dictation system (Disclosures No. BC8-97-0066
and BC8-97-0067). IBM Technical Disclosure Bulletin.
Lewis, J. R., Ortega, K. A., Van Buskirk, R. E., and Wang, H. (1998). Using speech
recognition to improve the accuracy of delayed handwriting recognition (Disclosure No.
BC8-98-0074). IBM Technical Disclosure Bulletin.
Ballard, B. E., Lewis, J. R., and Ortega, K. A. (1998). Lets user tune system to
recognize words in incomplete sentences (Disclosure No. BC8-97-0068).
IBM Technical Disclosure Bulletin.
Ballard, B. E., Lewis, J. R., and Ortega, K. A. (1998). Find and correct homonyms or
closely related words (Disclosure No. BC8-97-0065). IBM Technical
Disclosure Bulletin.
Lewis, J. R., and Van Buskirk, R. (1998). Distributed tutorials (Disclosure No.
BC8-97-0073). IBM Technical Disclosure Bulletin.
Eastwood, P. R., and Lewis, J. R. (1996). Proofreading aid for speech dictation
systems (Disclosure No. BC8-95-0120). IBM Technical Disclosure Bulletin, 39,
149.
Lewis, J. R. (1995). Improved measure of readability (Disclosure No. BC8-93-0366).
IBM Technical Disclosure Bulletin, 38, 189.
Au, C. Y., Canova, F. J., Eastwood, P. R., Goodwin, J. F., Hsieh, D. M., Lanier, C. S.,
Lewis, J. R., and Wulf, J. C. (1995). Simple user interface to a cellular telephone
(Disclosure No. BC8-94-0281). IBM Technical Disclosure Bulletin, 38, 349.
Lanier, C. S., Lewis, J. R., and Yee, R. L. (1995). Intelligent search through an
electronic address book (Disclosure No. BC8-94-0282). IBM Technical Disclosure
Bulletin, 38, 395-397.
Allard, D. J., Au, C. Y., Eastwood, P. R., Goodwin, J. F., Hsieh, D. M., Johnson, D. G.,
Lanier, C. S., Lewis, J. R., Stout, J. L., Tiller, B. K., Villafana, W., and Yee, R. L.
(1995). Audio/visual feedback for touch selection on liquid crystal display screen
(Disclosure No. BC8-94-0298). IBM Technical Disclosure Bulletin, 38, 525.
Allard, D. J., Hudson, H. D., and Lewis, J. R. (1995). Predictive keyboard optimized
for multiple text types (Disclosure No. BC8-93-0520). IBM Technical Disclosure
Bulletin, 38, 371-372.
Hsieh, D. M., Whitley, W. P., and Lewis, J. R. (1995). Auditory feedback method for
personal communicators (Disclosure No. BC8-94-0285). IBM Technical Disclosure
Bulletin, 38, 213-214.
Kennedy, P. J., LaLomia, M. J., and Lewis, J. R. (1994). Typing keyboard optimization
for hand-held computers (Disclosure No. BC8-92-0322). IBM Technical Disclosure
Bulletin, 37, 227-230.
Kennedy, P. J., LaLomia, M. J., and Lewis, J. R. (1994). Rectangular typing key
layout for hand-held computers (Disclosure No. BC8-92-0323). IBM Technical Disclosure
Bulletin, 37, 357-358.
Au, E., Fado, F., Kennedy, P. J., Lewis, J. R., McConnell, S., and Pfretzschner, C.
(1986). Improved reader slot design for swipe motion magnetic stripe badge readers
(Disclosure No. BC8-85-0226). IBM Technical Disclosure Bulletin, 29,
2188-2189.
Kennedy, P. J., Lewis, J. R., and Sassen, B. N. (1986). Bezel with finger guide pockets
for touch-sensitive panel (Disclosure No. BC8-85-0091). IBM Technical Disclosure
Bulletin, 29, 1375-1377.
Technical Reports
Lewis, J. R.
(2005). Usability testing
(Tech. Report 29.3820). Raleigh, NC: IBM Corp.
Millet, B., and Lewis, J. R.
(2004). Usability evaluation of prompt clarity for a language selection task
(Tech. Report 29.3819). Raleigh, NC: IBM Corp.
Commarford, P. M., and Lewis, J. R.
(2004). Word completion feature that recognizes implicit rejections
(Tech. Report 29.3812). Raleigh, NC: IBM Corp.
Lewis, J. R.
(2004). Actual versus estimated dictation accuracy
(Tech. Report 29.3790). Raleigh, NC: IBM Corp.
Lewis, J. R.
(2004). Sample size adequacy for usability studies: Current issues
(Tech. Report 29.3789). Raleigh, NC: IBM Corp.
Lewis, J. R.
(2004). Accuracy error span evaluations: Implications for user interface design of speech dictation and handwriting recognition applications
(Tech. Report 29.3788). Raleigh, NC: IBM Corp.
Gomez, F., Agapi, C., and Lewis, J. R.
(2004). Rapid VoiceXML developmeng using IBM’S graphical Call Flow Builder
(Tech. Report 29.3787). Raleigh, NC: IBM Corp.
Lewis, J. R.
(2004). Prototyping best-practice speech user interfaces with VoiceXML 2.0 and the IBM VoiceXML toolkit
(Tech. Report 29.3732). Raleigh, NC: IBM Corp.
Michelini, V., Agapi, C., Mirt, M., Wang, F., Lewis, J. R., and Polkosky, M. D.
(2004). A flexible method for manipulating fields in a directory assistance application
(Tech. Report 29.3731). Raleigh, NC: IBM Corp.
Lewis, J. R., Commarford, P. M., and Kotan, C. A.
(2003). Web-based comparison of two styles of Auditory presentation: All TTS versus
rapidly mixed TTS and recordings
(Tech. Report 29.3684). Raleigh, NC: IBM Corp.
Kotan, C. A., and Lewis, J. R.
(2003). Comparison of two delayed confirmation strategies for speech recognition
interactive voice response systems
(Tech. Report 29.3675). Raleigh, NC: IBM Corp.
Lewis, J. R., and Sadowski, W. J.
(2003). Analysis of reduction in passcode guessability as a function of conversion from
alphanumeric to numeric codes
(Tech. Report 29.3665). Raleigh, NC: IBM Corp.
Lewis, J. R.
(2003). Preliminary comparison of immediate and delayed confirmation strategies as a function of number of corrections
(Tech. Report 29.3663). Raleigh, NC: IBM Corp.
Lewis, J. R.
(2003). Prototyping the conversion from a directed dialog speech user interface to a natural commands user interface
(Tech. Report 29.3636). Raleigh, NC: IBM Corp.
Lewis, J. R.
(2002). Effect of level of problem description on problem discovery rate: Two case studies
(Tech. Report 29.3604). Raleigh, NC: IBM Corp.
Commarford, P. M.,
and Lewis, J. R. (2002). Models of throughput rates for dictation revisited:
Consideration of speech processing speed
(Tech. Report 29.3599). Raleigh, NC: IBM Corp.
Lewis, J. R.
(2002). Prototyping best-practice speech user interfaces with VoiceXML and the IBM VoiceXML Toolkit
(Tech. Report 29.3598). Raleigh, NC: IBM Corp.
Commarford, P. M, and Lewis, J. R.
(2002). Optimizing the pause length before presentation of always-active navigation commands
(Tech. Report 29.3594). Raleigh, NC: IBM Corp.
Lewis, J. R.
(2002). Effect of voice and bandwidth on MOS-X ratings
(Tech. Report 29.3550). Raleigh, NC: IBM Corp.
Commarford, P. M.,
and Lewis, J. R. (2002). Models of throughput rates for dictation and
voice spelling for handheld computers
(Tech. Report 29.3544). Raleigh, NC: IBM Corp.
Polkosky, M. D., and Lewis, J. R.
(2002). Enhancement of the Mean Opinion Scale - Expanded (MOS-X)
(Tech. Report 29.3542). Raleigh, NC: IBM Corp.
Lewis, J. R., and
Commarford, P. M. (2002). Developing and tuning a voice spelling alphabet
for devices with small displays (Tech. Report 29.3517). Raleigh, NC: IBM Corp.
Polkosky, M. D., and Lewis, J. R.
(2002). Development and psychometric evaluation of an expanded Mean Opinion Scale (MOS-X)
(Tech. Report 29.3499). Raleigh, NC: IBM Corp.
Wright, L. E., Hartley, M. W.,
and Lewis, J. R. (2002). Conditional probabilities for IBM Voice Browser 2.0 alpha
and alphanumeric recognition (Tech. Report 29.3498). Raleigh, NC: IBM Corp.
Lewis, J. R.
(2001). The accuracy wars: Journalists’ estimates of continuous speech
product dictation accuracy from 1997-1999
(Tech. Report 29.3465). Raleigh, NC: IBM Corp.
Lewis, J. R.
(2001). Estimating the effectiveness of automatic vocabulary expansion
(Tech. Report 29.3452). Raleigh, NC: IBM Corp.
Polkosky, M. D., and Lewis, J. R.
(2001). User preference for turntaking tones 2: Participant source issues and
additional data (Tech. Report 29.3447). Raleigh, NC: IBM Corp.
Polkosky, M. D., and Lewis, J. R.
(2001). Effect of ticking rate on user estimation of system response time:
Part 2 (Tech. Report 29.3446). Raleigh, NC: IBM Corp.
Lewis, J. R.
(2001). Frequency distributions for names and unconstrained words associated
with the letters of the English alphabet (Tech. Report 29.3437).
Raleigh, NC: IBM Corp.
Lewis, J. R.
(2001). Web-based usability evaluation of ink-on-page indicators
(Tech. Report 29.3428). Raleigh, NC: IBM Corp.
Polkosky, M. D., and Lewis, J. R.
(2001). Effect of ticking rate on user estimation of system response time
(Tech. Report 29.3425). Raleigh, NC: IBM Corp.
Lewis, J. R.
(2001). Preference for and accuracy with 55- and 99-page ThinkScribe selection slots
(Tech. Report 29.3424). Raleigh, NC: IBM Corp.
Hartley, M. W., and Lewis, J. R.
(2001). Conditional probabilities for IBM Voice Browser recognition of letters of the alphabet
(Tech. Report 29.3421). Raleigh, NC: IBM Corp.
Lewis, J. R.
(2001). Psychometric evaluation of the CSUQ using data from five years of usability studies
(Tech. Report 29.3418). Raleigh, NC: IBM Corp.
Lewis, J. R.
(2001). The revised Mean Opinion Scale (MOS-R): Preliminary psychometric evaluation
(Tech. Report 29.3414). Raleigh, NC: IBM Corp.
Polkosky, M. D., Sadowski, W. J.,
and Lewis, J. R. (2001). The uniqueness of initial words in news headlines
(Tech. Report 29.3412). Raleigh, NC: IBM Corp.
Polkosky, M. D., and Lewis, J. R.
(2001). The function of nonspeech audio in speech recognition applications: A review of the literature
(Tech. Report 29.3405). Raleigh, NC: IBM Corp.
Lewis, J. R.
(2001). Psychometric properties of the Mean Opinion Scale (Tech. Report 29.3403).
Raleigh, NC: IBM Corp.
Lewis, J. R.
(2001). Selection accuracy with a new pen-based selection device (Tech. Report 29.3396).
Raleigh, NC: IBM Corp.
Sadowski, W. J., and Lewis, J. R. (2001). Usability evaluation of the IBM
WebSphere WebVoice demo (Tech. Report 29.3387). Raleigh, NC: IBM Corp.
Lewis, J. R.
(2001). Sample size estimation and use of substitute audiences (Tech. Report 29.3385).
Raleigh, NC: IBM Corp.
Lewis, J. R.
(2000). Evaluation of problem discovery rate adjustment procedures for sample
sizes from two to ten (Tech. Report 29.3362). Raleigh, NC: IBM Corp.
Lewis, J. R.
(2000). Reducing the overestimation of p in problem discovery usability studies:
Normalization, regression, and a combination normalization/Good-Turing approach
(Tech. Report 29.3361). Raleigh, NC: IBM Corp.
Lewis, J. R.
(2000). Using discounting methods to reduce overestimation of p in problem discovery
usability studies (Tech. Report 29.3359). Raleigh, NC: IBM Corp.
Lewis, J. R.
(2000). Overestimation of p in problem discovery usability studies: How serious is the
problem? (Tech. Report 29.3358). Raleigh, NC: IBM Corp.
Lewis, J. R.
(2000). Validation of Monte Carlo estimation of problem discovery likelihood
(Tech. Report 29.3357). Raleigh, NC: IBM Corp.
Sadowski, W. J., and
Lewis, J. R. (2000). Wizard of Oz usability evaluation of the IBM WebSphere 'WebVoice'
Demo (Tech. Report 29.3321). Raleigh, NC: IBM Corp.
Sadowski, W. J., and
Lewis, J. R. (2000). Usability evaluation of speech user interfaces for three currency
conversion prototypes (Tech. Report 29.3308). Raleigh, NC: IBM Corp.
Lewis, J. R.
(2000). Testing natural language application recognition accuracy and habitability
(Tech. Report 29.3297). Raleigh, NC: IBM Corp.
Lewis, J. R.,
Simone, J. E., and Bogacz, M. (2000). Designing common functions for speech-only user
interfaces: Rationales, sample dialogs, potential uses for event counting, and sample
grammars (Tech. Report 29.3287). Raleigh, NC: IBM Corp.
Lewis, J. R. (2000).
Developing minimal comprehensive sets of test cases for natural command grammars
(Tech. Report 29.3272). Raleigh, NC: IBM Corp.
Lewis, J. R. (1999).
Streamlining a general test plan for competitive evaluation of dictation accuracy and
throughput (Tech. Report 29.3158). Raleigh, NC: IBM Corp.
Lewis, J. R.
(1997). A general plan for conducting human factors studies of competitive speech
dictation accuracy and throughput (Tech. Report 29.2246). Raleigh, NC: IBM Corp.
Lewis, J. R. (1995). Reaping the benefits of modern usability evaluation: The
Simon story (Tech. Report 54.948). Boca Raton, FL: International Business Machines
Corp.
Lewis, J. R. (1995). A stimulus resource for lexical decision experiments
(Tech. Report 54.904). Boca Raton, FL: International Business Machines Corp.
Lewis, J. R. (1995). Meta-analysis of preference for split versus standard
keyboards: Findings from 1972 to 1993 (Tech. Report 54.899). Boca Raton, FL:
International Business Machines Corp.
Lewis, J. R. (1995). The effects of standard typing experience and split
keyboard experience on split keyboard experimental outcomes: Evidence from the split
keyboard literature (Tech. Report 54.898). Boca Raton, FL: International Business
Machines Corp.
Lewis, J. R. (1995). Input rates and user preference for three small-screen input
methods: Standard keyboard, predictive keyboard, and handwriting (Tech. Report 54.889).
Boca Raton, FL: International Business Machines Corp.
Lewis, J. R. (1994). Small-sample evaluation of the Paulson-Takeuchi approximation
to the exact binomial confidence interval (Tech. Report 54.872). Boca Raton, FL:
International Business Machines Corp.
Lewis, J. R. (1994). Direction stereotypes for setting dates and times
(Tech. Report 54.867). Boca Raton, FL: International Business Machines Corp.
Lewis, J. R. (1994). Competitive usability evaluation of Sharp Wizard OZ-9600,
Hewlett-Packard HP-95LX, and Angler (Tech. Report 54.866). Boca Raton, FL:
International Business Machines Corp.
Lewis, J. R., LaLomia, M. J., and Miranda, S. (1994). Competitive evaluation of
Newton using personal communicator scenarios (Tech. Report 54.865). Boca Raton, FL:
International Business Machines Corp.
Lewis, J. R. (1994). Speaking Simon: Simon's language guidelines and automated
readability measures (Tech. Report 54.864). Boca Raton, FL: International Business
Machines Corp.
Lewis, J. R., Allard, D. J., and Hudson, H. D. (1994). Predictive keyboard design
study: Effects of different word populations, number of displayed letters, and number of
trigraph tables (Tech. Report 54.846). Boca Raton, FL: International Business Machines
Corp.
Lewis, J. R. (1994). A critical literature review of human factors studies of split
keyboards from 1926 to 1993 (Tech. Report 54.853). Boca Raton, FL: International
Business Machines Corp.
Lewis, J. R. (1993). Name length statistics for touch-screen buttons (Tech.
Report 54.810). Boca Raton, FL: International Business Machines Corp.
Lewis, J. R. (1993). An icon usability evaluation procedure with application to
Personal Communicator common icons (Tech. Report 54.792). Boca Raton, FL: International
Business Machines Corp.
Lewis, J. R. (1993).
IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions
for use (Tech. Report 54.786). Boca Raton, FL: IBM Corp.
Lewis, J. R. (1993).
Relative importance of the components of the cloudiness count: Passive voice and infrequent
words (Tech. Report 54.759). Boca Raton, FL: IBM Corp.
Lewis, J. R. (1993). Calendar entry statistics for computer calendar users
(Tech. Report 54.754). Boca Raton, FL: International Business Machines Corp.
Lewis, J. R. (1993). The Kruskal-Wallis rank sum test with multiple comparisons: A
BASIC program (Tech. Report 54.732). Boca Raton, FL: International Business Machines
Corp.
Lewis, J. R. (1993). The Friedman rank sum test with multiple comparisons: A BASIC
program (Tech. Report 54.733). Boca Raton, FL: International Business Machines Corp.
Lewis, J. R. (1992). Typing key layouts for single-finger or stylus input: Initial
user preference and performance (Tech. Report 54.729). Boca Raton, FL: International
Business Machines Corp.
Lewis, J. R. (1992). A study of the perceived value of color illustrations in
documentation: Preliminary results (Tech. Report 54.719). Boca Raton, FL: International
Business Machines Corp.
Lewis, J. R. (1992). Psychometric evaluation of the Computer System Usability
Questionnaire: The CSUQ (Tech. Report 54.723). Boca Raton, FL: International Business
Machines Corp.
Lewis, J. R. (1992). IBM employees' satisfaction with their computer systems:
Initial norms for the Computer System Usability Questionnaire (Tech. Report 54.728).
Boca Raton, FL: International Business Machines Corp.
Lewis, J. R.
(1992). Sample sizes for usability studies: Additional considerations
(Tech. Report 54.711). Boca Raton, FL: IBM Corp.
Lewis, J. R. (1992). An alternative digraph-based typing-key layout for single-finger
or stylus input (Tech. Report 54.710). Boca Raton, FL: International Business Machines
Corp.
Lewis, J. R. (1992). The kappa measure of interrater agreement: Two BASIC
programs (Tech. Report 54.695). Boca Raton, FL: International Business Machines
Corp.
Lewis, J. R. (1992). The Kolmogorov-Smirnov test for identical populations: A
BASIC program (Tech. Report 54.697). Boca Raton, FL: International Business Machines
Corp.
Lewis, J. R. (1992). The Friedman rank sum test with a correction for ties: A BASIC
program (Tech. Report 54.696). Boca Raton, FL: International Business Machines Corp.
Lewis, J. R. (1992).
Literature review of touch-screen research from 1980 to 1992 (Tech. Report 54.694).
Boca Raton, FL: IBM Corp.
Lewis, J. R. (1992). Pairs of Latin squares that simultaneously counterbalance
immediate sequential effects and condition-stimulus pairing: A BASIC program (Tech.
Report 54.673). Boca Raton, FL: International Business Machines Corp.
Lewis, J. R., Kennedy, P. J., and LaLomia, M. J. (1992). Improved typing key
layouts for single-finger or stylus input (Tech. Report 54.692). Boca Raton, FL:
International Business Machines Corp.
Kennedy, P. J., Pruitt, J. S., and Lewis, J. R. (1992). An evaluation of the
readability of anti-aliased CRT typeface versus Adobe Type Manager bi-level typeface
(Tech. Report 54.663). Boca Raton, FL: International Business Machines Corp.
Loricchio, D. F. and Lewis, J. R. (1992). Integrated pointing devices for the PS/2
keyboard: 16 mm trackball, 25 mm trackball, and the pointing stick (Tech. Report 54.698).
Boca Raton, FL: International Business Machines Corp.
Lewis, J. R. (1992). Using scenario step counts to predict expert user time-on-task:
A case study (Tech. Report 54.653). Boca Raton, FL: International Business Machines
Corp.
Lewis, J. R., and Tripi, B.
(1992). Competitive evaluation of documentation: Surveys and automated readability
measures (Tech. Report 54.647). Boca Raton, FL: IBM Corp.
Lewis, J. R. (1991). The predictive accuracy of design studies: A case study
(Tech. Report 54.611). Boca Raton, FL: International Business Machines Corp.
Lewis, J. R. (1991). User satisfaction questionnaires for usability studies: 1991
manual of directions for the PSSUQ and the ASQ (Tech. Report 54.609). Boca Raton, FL:
International Business Machines Corp.
Lewis, J. R. (1991). Legitimate use of small samples in usability studies: Three
examples (Tech. Report 54.594). Boca Raton, FL: International Business Machines Corp.
Weild, N. E., Lewis, J. R., and Kennedy, P. J. (1991). Two tablet computer usability
studies: Tethered versus untethered pens and varied tablet dimensions
(Tech. Report 54.588). Boca Raton, FL: International Business Machines Corp.
Lewis, J. R. (1991). An after-scenario questionnaire for usability studies:
Psychometric evaluation over three trials (Tech. Report 54.584). Boca Raton, FL:
International Business Machines Corp.
Lewis, J. R., Bloch, D. R. and Korn, P. A. (1991). Multimedia usability
requirements: Findings from the Boca Raton Multimedia QFD customer visits.
(Tech. Report 54.576). Boca Raton, FL: International Business Machines Corp.
Lewis, J. R. (1990). Sample sizes for observational usability studies: Tables based
on the binomial probability formula (Tech. Report 54.571). Boca Raton, FL: International
Business Machines Corp.
Lewis, J. R. and Pallo, S. (1990). Evaluation of graphic symbols for PHONE and
LINE (Tech. Report 54.572). Boca Raton, FL: International Business Machines Corp.
King, L., Lee, R., and Lewis, J. R. (1990). Errata sheet effectiveness: A risk
assessment (Tech. Report 54.567). Boca Raton, FL: International Business Machines
Corp.
Lewis, J. R. and Ryan, K. S. (1990). User assessment of the value of a hard file
in-use indicator for floor-standing personal computers (Tech. Report 54.539). Boca
Raton, FL: International Business Machines Corp.
Lewis, J. R. (1990). A simple usability study pretest for dexterity: Reliability
and revised local norms (Tech. Report 54.545). Boca Raton, FL: International Business
Machines Corp.
Lewis, J. R. (1990). Psychometric evaluation of a post-study system usability
questionnaire: The PSSUQ (Tech. Report 54.535). Boca Raton, FL: International
Business Machines Corp.
Lewis, J. R. (1990). A simple usability pretest for dexterity: Local norms and
predictive validity (Tech. Report 54.538). Boca Raton, FL: International Business
Machines Corp.
Lewis, J. R. (1990). Psychometric evaluation of an after-scenario questionnaire
for computer usability studies: The ASQ (Tech. Report 54.541). Boca Raton, FL:
International Business Machines Corp.
Lewis, J. R. (1990). Using the reading comprehension section of the Iowa Silent
Reading Test as a usability study pretest: Local norms and predictive validity (Tech.
Report 54.537). Boca Raton, FL: International Business Machines Corp.
Lewis, J. R. (1989). The relative reliabilities of mean and median differences as
indicators of statistically significant differences for 7-point scales (Tech. Report
54.532). Boca Raton, FL: International Business Machines Corp.
Lewis, J. R. (1988). Human factors study of an improved slot design for swipe
motion magnetic stripe badge readers (Tech. Report 54.482). Boca Raton, FL:
International Business Machines Corp.
Lewis, J. R. (1988). The PLANBUILDER system: System administrator's guide
(Tech. Report 54.476). Boca Raton, FL: International Business Machines Corp.
Lewis, J. R. (1988). The PLANBUILDER system: PLAN diskette user's guide
(Tech. Report 54.477). Boca Raton, FL: International Business Machines Corp.
Lewis, J. R. (1988). The PLANBUILDER system: The COMBINE program (Tech.
Report 54.478). Boca Raton, FL: International Business Machines Corp.
Lewis, J. R., Snyder, K. M., and Happ, A. J. (1988). Measuring the similarity of
menu structures (Tech. Report 54.455). Boca Raton, FL: International Business Machines
Corp.
Kennedy, P. J. and Lewis, J. R. (1988). Using Keysave to analyze personal computer
use in an application environment (Tech. Report 54.458). Boca Raton, FL: International
Business Machines Corp.
Lewis, J. R. (1987). Developing the Personal System/2 mouse: Human factors studies
(Tech. Report 54.426). Boca Raton, FL: International Business Machines Corp.
Lewis, J. R. (1986). Analysis of a symbol evaluation methodology (Tech. Report
54.413). Boca Raton, FL: International Business Machines Corp.
Snyder, K. M., Happ, A. J., Paap, K., Malcus, L., Dyck, J., Rotella, J., and Lewis, J. R.
(1986). Using cognitive networks to create menus (Tech. Report 54.405). Boca Raton,
FL: International Business Machines Corp. (Also in 1986 Human Factors/Product Usability ITL
Meeting, pp. 131-137, San Jose, CA.)
Lewis, J. R. (1986). User reaction to three personal computer design concepts
(Tech. Report 54.398). Boca Raton, FL: International Business Machines Corp.
Lewis, J. R. (1985). Human factors study of two safety symbols (Tech. Report
54.396). Boca Raton, FL: International Business Machines Corp.
Lewis, J. R. (1985). Two and three button mice with TopView (Tech. Report
54.363). Boca Raton, FL: International Business Machines Corp.
Lewis, J. R. (1985). Personal computer key frequencies: A human factors field study
with emphasis on the frequency of acquisition of the backspace and enter keys (Tech.
Report 54.352). Boca Raton, FL: International Business Machines Corp.
Lewis, J. R. (1985). Pointing devices with TopView: The keyboard, mouse, and
touchpad (Tech. Report 54.355). Boca Raton, FL: International Business Machines Corp.
Lewis, J. R. (1985). Human factors evaluation of four magnetic stripe readers for
time and attendance use (Tech. Report 54.402). Boca Raton, FL: International Business
Machines Corp.
Lewis, J. R. (1984). Development of a competitive printer usability database and
application of a competitive usability analysis procedure (Tech. Report 54.310). Boca
Raton, FL: International Business Machines Corp.
Lewis, J. R. (1984). Usability comparison of competitive products with ranks
(Tech. Report 54.306). Boca Raton, FL: International Business Machines Corp.
Lewis, J. R. (1984). The Decision Data 6541-04 printer: A usability study
(Tech. Report 54.305). Boca Raton, FL: International Business Machines Corp.
Lewis, J. R. (1984). The TI 810LQ printer: A usability study (Tech.
Report 54.295). Boca Raton, FL: International Business Machines Corp.
Lewis, J. R. (1983). The DEC Letterprinter 100 printer: A usability study (Tech.
Report 54.290). Boca Raton, FL: International Business Machines Corp.
Lewis, J. R. (1983). The IBM 3287 Model 2C printer: A usability study
(Tech. Report 54.286). Boca Raton, FL: International Business Machines Corp.
Lewis, J. R. (1983). The IBM Model 4975 Model 2L printer: A usability study
(Tech. Report 54.275). Boca Raton, FL: International Business Machines Corp.
Lewis, J. R. and Watson, A. L. (1983). The IBM 5224 Model 2 printer: A usability
study (Tech. Report 54.272). Boca Raton, FL: International Business Machines Corp.
Lewis, J. R. (1983). The Centronix 353 printer: A usability study
(Tech. Report 54.263). Boca Raton, FL: International Business Machines Corp.
Lewis, J. R. (1983). Customer setup and operator procedures: Guidelines for
designing study and test plans (Tech. Report 54.215). Boca Raton, FL: International
Business Machines Corp.
Newsletter Articles (both IBM Internal and external to IBM)
Lewis, J. R.
(2001). Voicing psychology at Big Blue. APS Observer, 14(1),
6, 25.
Lewis, J. R. (1993). The Kruskal-Wallis rank sum test with multiple comparisons: A BASIC
program. StatiShare. Rochester, MN: IBM Statistical Competency Center.
Lewis, J. R. (1993). The Friedman rank sum test with a correction for ties:
A BASIC program. StatiShare. Rochester, MN: IBM Statistical Competency Center.
Lewis, J. R. (1993). The Kolmogorov-Smirnov test for identical populations:
A BASIC program. StatiShare. Rochester, MN: IBM Statistical Competency Center.
Lewis, J. R. (1992). The kappa measure of interrater agreement: Two BASIC programs.
StatiShare. Rochester, MN: IBM Statistical Competency Center.
Lewis, J. R. (1992). Pairs of Latin squares that counterbalance immediate sequential
effects in a Greco-Latin design: A BASIC program. StatiShare. Rochester, MN: IBM
Statistical Competency Center.
Lewis, J. R. (1992). Binomial confidence intervals for small sample usability studies.
StatiShare. Rochester, MN: IBM Statistical Competency Center.
Lewis, J. R. (1991). Using scenario step counts to predict expert user time-on-task:
A case study. StatiShare. Rochester, MN: IBM Statistical Competency Center.
Lewis, J. R. (1991). A rank-based method for the usability comparison of competing
products. StatiShare. Rochester, MN: IBM Statistical Competency Center.
Lewis, J. R. (1990). Perspective: The review process. Innovations, 3,
31.
Lewis, J. R. (1990). The relative reliabilities of mean and median differences as
indicators of statistically significant differences for 7-point scales. StatiShare.
Rochester, MN: IBM Statistical Competency Center.
Lewis, J. R. (1989). Pairs of Latin squares to counterbalance sequential effects and
pairing of conditions and stimuli. StatiShare. Rochester, MN: IBM Statistical
Competency Center.
Chessin, P. L. and Lewis, J. R. (1988). Why not write it up? Innovations,
1, 10-11.
Lewis, J. R., Snyder, K. M., and Happ, A. J. (1987). A method for describing the
similarity of two menu structures. StatiShare. Rochester, MN: IBM Statistical
Competency Center.
Lewis, J. R. (1986). Analysis of preference votes: a misuse of chi-squared.
StatiShare. Rochester, MN: IBM Statistical Competency Center.
Lewis, J. R. (1985). Observational studies: How many participants? StatiShare.
Rochester, MN: IBM Statistical Competency Center.
Theses and Dissertations
Lewis, J. R. (1996). Local contextual impenetrability of lexical access and
gap-filling: A comparison of outcomes from cross-modal lexical priming and word-by-word
reading tasks. Doctoral dissertation in partial fulfillment of Ph.D.
in experimental psychology.
Lewis, J. R. (1981). Fitt's law and the control/display ratio.
Master's thesis in partial fulfillment of MA in experimental psychology.
Lewis, J. R. (1978). Generating computer music at NMSU. Master's thesis in
partial fulfillment of MM in music theory and composition.
US Patents
Lewis, J. R., Ortega, K. A., and Wang, H. (2006).
Method for guiding text-to-speech output timing using speech recognition markers.
Issued as Patent 7010489 in the U.S.
Hartley, M. W., Lewis, J. R., and Ma, D. F. (2005).
Voice spelling in an audio-only interface.
Issued as Patent 6975986 in the U.S.
Hartley, M. W., Lewis, J. R., and Reich, D. E. (2005).
Method of speech recognition using empirically determined word candidates.
Issued as Patent 6963834 in the U.S.
Lewis, J. R., Maners, J. E., Ortega, K. A., Perrone, M. P., Ratzlaff, E. H., Subrahmonia, J., Van Buskirk, R., and Wang, H. (2004).
System and method for automatic quality assurance of user enrollment in a recognition system.
Issued as Patent 6826306 in the U.S.
Lewis, J. R., and Kist, T. (2004). Method of providing concise forms of natural commands.
Issued as Patent 6801897 in the U.S.
Lewis, J. R., and Ortega, K. A. (2004).
Method for enhancing dictation and command discrimination.
Issued as Patent 6795806 in the U.S.
Lewis, J. R. (2004). Method of decoding telegraphic speech.
Issued as Patent 6772116 in the U.S.
Lewis, J. R., Keller, A., Hanson, G. R., Van Buskirk, R. E., Ballard, B. E., and
Ortega, K. A. (2004). Method and system for proofreading and correcting dictated
text. Issued as Patent 6760700 in the U.S.
Lewis, J. R., Kist, T. A., Boyer, L. M., Smith, M. E., and Ortega, K. A. (2004).
System and method for concurrent presentation of multiple audio information sources. Filed as Docket BC9-98-106
in the U.S. Issued as Patent 6757656 in the U.S.
Lewis, J. R., Kist, T. A., Boyer, L. M., Smith, M. E., and Ortega, K. A. (2004).
Method and apparatus for recognizing "FROM HERE - TO HERE" voice command
structures in a finite grammar speech recognition system. Filed as Docket BC9-98-106
in the U.S. Issued as Patent 6745165 in the U.S.
Lewis, J. R., and Ortega, K. A. (2004). Transcribing text from computer voice
mail. Filed as Docket BC9-99-018 in the U.S. Issued as Patent 6775651 in the U.S.
Lewis, J. R., Keller, A., Egger, H., Van Buskirk, R. E., Ortega, K. A., and Wang, H.
(2004). Method and apparatus for improving speech recognition accuracy.
Issued as Patent 6675142 in the U.S.
Lewis, J. R., Horowitz, B., and Reich, D. E. (2003).
Speech recognition system for database access through the use of data domain overloading of grammars.
Issued as Patent 6662157 in the U.S.
Kemble, K. A., Lewis, J. R., Michelini, V. V., and Zabolotskaya, M. (2003).
Dynamically adjusting speech menu presentation style.
Issued as Patent 6658386 in the U.S.
Lewis, J. R., Tan, J. W., and Boyer, L. M. (2003). Speech enabling labeless
controls in an existing graphical user interface.
Issued as Patent 6615176 in the U.S.
Lewis, J. R., Keller, A., Hanson, G. R., Van Buskirk, R. E., Ballard, B. E., and
Ortega, K. A. (2003). Method and system for proofreading and correcting dictated
text. Issued as Patent 6611802 in the U.S.
Lewis, J. R., and Ortega, K. A. (2003). Method and system for determining available
and alternative speech commands.
Issued as Patent 6591236 in the U.S.
Lewis, J. R., and Ballard, B. E. (2003). Method and apparatus for intelligently
managing multiple pronunciations for a speech recognition vocabulary.
Issued as Patent 6577999 in the U.S.
Lewis, J. R., Van Buskirk, R. E., Ortega, K. A., and Wang, H. (2003). Speech
recognition enrollment for non-readers and displayless devices.
Issued as Patent 6560574 in the U.S.
Lewis, J. R., Van Buskirk, R. E., Ortega, K. A., and Wang, H. (2003). Method and
apparatus for transcribing multiple files into a single document.
Issued as Patent 6535848 in the U.S.
Lewis, J. R., Tan, J. W., Boyer, L. M., and Ortega, K. A. (2003). Method for
hands-free operation of a pointer.
Issued as Patent 6518566 in the U.S.
Lewis, J. R., Keller, A., Egger, H., Van Buskirk, R. E., Ortega, K. A., and Wang, H.
(2002). Method and apparatus for improving speech recognition accuracy.
Issued as Patent 6370503 in the U.S.
Lewis, J. R., and
Ortega, K. A. (1999). Adding a vocabulary word by using the language model
statistics of another word.
Issued as Patent 6334102 in the U.S.
Lewis, J. R., Nassiff, A., Van Buskirk, R. E., Ortega, K. A., and Wang, H. (1998).
Method and apparatus for improving speech command recognition accuracy using event-based
constraints. Issued as Patent 6345254 in the U.S.
Lewis, J. R., Nassiff, A.,
Van Buskirk, R. E., Ortega, K. A., and Wang, H. (1998).
Method and apparatus for providing an event-based what-can-I-say window.
Issued as Patent 6308157 in the U.S.
Lewis, J. R., Ratzlaff, E. H., Pitrelli, J. F., Subrahmonia, J., and Perrone, M. (1998).
System and method for providing user-directed constraints for handwriting recognition.
Issued as Patent 6401067 in the U.S.
Lewis, J. R. (1998). Method and system for generating a minimal set of test phrases
for testing a natural commands grammar. Issued as Patent 6275792 in the U.S.
Lewis, J. R., Van Buskirk, R. E., Ortega, K. A., and Wang, H. (1998). Method and
apparatus for correcting misinterpreted voice commands in a speech recognition system.
Issued as Patent 6327566 in the U.S.
Lewis, J. R., Van Buskirk, R. E., Maes, S. H., Ortega, K. A., and Wang, H. (1998).
System to transcribe multiple speakers using speaker ID.
Issued as Patent 6332122 in the U.S.
Lewis, J. R., Van Buskirk, R. E., Ortega, K. A., and Wang, H. (1998). Method and
apparatus for activating and deactivating auxiliary topic libraries in a speech dictation
system. Issued as Patent 6360201 in the U.S.
Lewis, J. R., Van Buskirk, R. E., Ortega, K. A., and Wang, H. (1998). Speech
recognition enrollment for non-readers and displayless devices.
Issued as Patent 6324507 in the U.S.
Lewis, J. R. (1998). Determining theft of grammar code.
Issued as Patent 6115820 in the U.S.
Lewis, J. R., Gong, Q., Van Buskirk, R. E., and Wang, H. (1998). Natural speech
error correction for character languages.
Issued as Patent 6260015 in the U.S.
Lewis, J. R., and Ballard, B. E. (1998). Method and system for distinguishing between
text insertion and replacement.
Issued as Patent 6253177 in the U.S.
Lewis, J. R., Ortega, K. A., and Ballard, B. E. (1998). Method and apparatus for
propagating corrections in speech recognition software.
Issued as Patent 6314397 in the U.S.
Lewis, J. R., Keller, A., Kist, T. A., Boyer, L. M., Van Buskirk, R. E., Ballard, B. E.,
and Ortega, K. A. (1998). Managing voice commands in speech applications.
Issued as Patent 6182046 in the U.S.
Lewis, J. R., and Ballard, B. E. (1998). Noise recognizer for speech recognition
systems. Issued as Patent 6324499 in the U.S.
Lewis, J. R. (1998). Method and apparatus for automatically determining whether to
update a language model in a speech recognition system.
Issued as Patent 6275803 in the U.S.
Lewis, J. R., and Smith, M. E. (1998). Automatically updating language models.
Issued as Patent 6138099 in the U.S.
Lewis, J. R., and Van Buskirk, R. (1998). Multiple function graphical user interface
minibar. Issued as Patent 6075534 in the U.S.
Lewis, J. R., and Ortega, K. A. (1998). Reconciling recognition and text-to-speech
vocabularies. Issued as Patent 6119085 in the U.S.
Lewis, J. R., and Ortega, K. A. (1998). Using TTS to fill in for missing dictation
audio. Issued as Patent 6023678 in the U.S.
Lewis, J. R. (1998). A proofreading aid based on the analysis of closed-class
vocabulary (function) words. Issued as Patent 6081772 in the U.S.
Ballard, B. E., Lewis, J. R., Ortega, K. A., and Van Buskirk, R. (1998). Method for
correcting frequently misrecognized words or commands in speech applications.
Issued as Patent 5970451 in the U.S.
Allard, D. J., Au, C. Y., Beatty, B. A., Canova, Jr., F. J., Corkell, A. F., Cox, R. L.,
DeBauche, B. J., Ferrier, R. B., Goodwin, J. F., Hsieh, D. M., Johnson, D. G., Lanier, C. S.,
Lewis, J. R., Murakami, T. T., Osborn, N., Padgett, R. S., Rivero, J. L., Stout, J. L.,
Tiller, B. K, Villafana, W., Whitley, W. P., Wulf, J. C., and Yee, R. L. (1994).
Selective reconfiguration method and apparatus. Issued as Patent 5568536 in the U.S.
Allard, D. J., Au, C. Y., Canova, Jr., F. J., Goodwin, J. F., Hsieh, D. M., Johnson, D. G.,
Lanier, C. S., Lewis, J. R., Tiller, B. K, Villafana, W., and Yee, R. L. (1994).
Apparatus and method for marking text on a display screen in a personal communications
device. Issued as Patent 5815142 in the U.S.
Goodwin, J. F., Johnson, D. G., Lewis, J. R., Rasmussen, D. J., Tiller, B. K., and
Yee, R. L. (1994). Method and apparatus for consistent user interface in a multiple
application personal communications device.
Issued as Patent 5619684 in the U.S.
Goodwin, J. F., Lanier, C. S., Lewis, J. R., Tiller, B. K., and Yee, R. L. (1994).
Intelligent search for personal communicator electronic address book.
Issued as Patent 5708804 in the U.S.
Allard, D. J., Beatty, B. A., Canova, Jr., F. J., DeBauche, B. J., Hsieh, D. M.,
Johnson, D. G., Lanier, C. S., Lewis, J. R., Tiller, B. K., Villafana, W., and Yee, R. L.
(1993). Personal communicator having improved contrast control for a liquid crystal,
touch sensitive display. Issued as Patent 5422656 in the U.S.
Allard, D. J., Canova, Jr., F. J., Johnson, D. G., Lanier, C. S., Lewis, J. R.,
Tiller, B. K., Villafana, W., and Yee, R. L. (1993). Fax zoom and pan functions.
Issued as Patent 5615384 in the U.S.
Musical Compositions Performed (All music copyrighted by James R. Lewis)
10/21/1976 Percussion Ensemble I, for 4 percussionists
(RealMedia)
10/07/1976 Idyll, for flute and tape
04/19/1976 Plastics, for tape
(RealMedia)
04/19/1976 Nightwatch, MUSIC4BF composition for computer
(RealMedia)
04/19/1976 JS Bach Invention in A Minor, MUSIC4BF arrangement for computer
(RealMedia)
05/08/1975 Canterbury Sketches, for flute and piano
05/08/1975 Arabian Fantasy, for solo piano
05/08/1975 A Memory, for viola and piano
05/08/1975 Image I, for interior piano
04/04/1974 The Mutation of J Alfred Prufrock, musique concrete for tape
(RealMedia)
04/04/1974 Pollichinelle, for solo piano
(ReadMedia)
04/04/1974 Reflection, for solo piano
(RealMedia)
Creative Non-Professional Activities
Hobbies and Other Leisure Interests
Reading, writing, cinema, musical theater, popular music, music composition, taekwondo
Popular Songs (all music copyright James R. Lewis)
Lost and Alone Again (Copyright 1990 James R. Lewis and Catherine A. Lewis,
Vocals: Kevin Kelly, Piano: Jim Lewis)
(RealMedia)
Elizabeth (Moog synthesizer) (Copyright 1973)
(RealMedia)
Elizabeth (Piano version) (Copyright 1973)
(RealMedia)
Foreign Languages
Spanish (moderate reading/writing and speaking skill)
Romanian (limited reading/writing and speaking skill)
Awards and Honors
2005: Author Awards, two refereed conference papers
2005: IBM Invention Achievement Awards, Twenty-Fifth Plateau
2004: IBM Invention Achievement Awards, Twenty-Second through Twenty-Fourth Plateaus
2004: IBM Raleigh Author Recognition Program, Forty-Ninth through Fifty-First
Plateaus (program discontinued in 2004)
2003: IBM Invention Achievement Awards, Nineteenth through Twenty-First Plateaus
2003: Execute Now! Award for usability leadership in speech browser design
2003: Supplemental IBM Invention Achievement Awards, Issued patent rated in top 10%
2003: IBM Raleigh Author Recognition Program, Forty-Fifth through Forty-Eighth
Plateaus
2002: IBM Invention Achievement Awards, Seventeenth and Eighteenth Plateaus
2002: IBM Raleigh Author Recognition Program, Thirty-Eighth through Forty-Fourth
Plateaus
2001: IBM Invention Achievement Awards, Fourteenth through Sixteenth Plateaus
2001: IBM Raleigh Author Recognition Program, Twenty-ninth through Thirty-Seventh
Plateaus
2001: IBM UCD Advisory Council Team Award
2000: IBM Invention Achievement Awards, Twelfth and Thirteenth Plateaus
2000: IBM Raleigh Author Recognition Program, Twenty-second through Twenty-eighth
Plateaus
1999: IBM Raleigh Author Recognition Program, Seventeenth through Twenty-first
Plateaus
1999: IBM Invention Achievement Awards, Sixth through Eleventh Plateaus
1998: IBM Invention Achievement Awards, Fourth through Fifth Plateaus
1997: IBM Invention Achievement Award, Third Plateau
1995: IBM Boca Raton Author Recognition Program, Fifteenth and Sixteenth Plateaus
1995: IBM Invention Achievement Award, Second Plateau
1994: IBM Invention Achievement Award, First Plateau
1994: IBM Boca Raton Author Recognition Program, Thirteenth and Fourteenth Plateaus
1993: IBM Boca Raton Author Recognition Program, Tenth through Twelfth Plateaus
1992: STC Florida Technical Publications Competition - Merit Award
1992: IBM Boca Raton Author Recognition Program, Eighth and Ninth Plateaus
1992: Informal Award for usability contributions to PS/2 Model 57 Ultimedia
1991: STC Florida Technical Publications Competition - Distinguished Technical
Communication Award
1991: ESD Divisional Award for usability leadership in development of PS/2 Models
90 and 95
1991: IBM Boca Raton Author Recognition Program, Fifth through Seventh Plateaus
1990: IBM Boca Raton Author Recognition Program, Fourth Plateau
1989: IBM Boca Raton Author Recognition Program, Third Plateau
1989: Application Systems Divisional award for competitive evaluation of
workstations and office applications
1988: IBM Boca Raton Author Recognition Program, First and Second Plateaus
1987: IBM Spotlight Award for development of a data collection system for the
Development Operations and Technology semi-annual business plan
1987: Accepted to University of Pennsylvania Law School
1985: IBM Spotlight Award for timely work evaluating PC designs
1984: IBM Informal Award for work on IBM 4224 printer competitive evaluation
1974: Elected to Phi Kappa Phi honor society
1973: Band Scholarship, New Mexico State University
1971: Accepted University Tuition Scholarship to New Mexico State University
1971: National Merit Scholarship Qualifying Test finalist, offered scholarship to
Michigan State University
1971: Elected to National Honor Society, named outstanding member, Alamogordo High
School
1971: Gold "A" in Spanish, Alamogordo High School
References
Available on request.