-
-
Notifications
You must be signed in to change notification settings - Fork 769
Add manual smoke test plans for MS Office, Libre Office, Web Browsers, IDEs #18419
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: master
Are you sure you want to change the base?
Changes from 1 commit
2488e97
c099bbd
f209a40
a9477ff
474e3fc
4045525
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
| Original file line number | Diff line number | Diff line change | ||||
|---|---|---|---|---|---|---|
| @@ -0,0 +1,142 @@ | ||||||
| # NVDA LibreOffice Smoke Testing Plan | ||||||
|
|
||||||
| ## Objective | ||||||
|
|
||||||
| To ensure NVDA functions correctly with LibreOffice applications (Writer, Calc, Impress) across typical user workflows. | ||||||
| This plan focuses on basic navigation, document interaction, and accessibility of key features. | ||||||
|
|
||||||
| ## Applications Covered | ||||||
|
|
||||||
| * Writer | ||||||
| * Calc | ||||||
| * Impress | ||||||
|
|
||||||
| --- | ||||||
|
|
||||||
| ## Writer Smoke Tests | ||||||
|
|
||||||
| ### 1. Launch and Document Navigation | ||||||
|
|
||||||
| #### Steps | ||||||
|
|
||||||
| 1. Launch Writer | ||||||
| 1. Verify NVDA announces the Writer window title | ||||||
| 1. Use `ctrl+n` to create a new document | ||||||
| 1. Use `tab` to move through the toolbar and document area | ||||||
|
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. This will just insert tabs into the document
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
|
||||||
| 1. Use arrow keys to move through the document | ||||||
|
|
||||||
| #### Expected Results | ||||||
|
|
||||||
| * NVDA announces window title, toolbar, and document area | ||||||
| * Navigation is smooth and consistent | ||||||
|
|
||||||
| ### 2. Basic Editing and Formatting | ||||||
|
|
||||||
| #### Steps | ||||||
|
|
||||||
| 1. Type sample text | ||||||
|
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Is it worth mentioning that you can get some sample text to work with by typing "DT" or "LOREM" followed by |
||||||
| 1. Use `ctrl+b` to bold, `ctrl+i` to italic, `ctrl+u` to underline | ||||||
| 1. Use `ctrl+s` to save, `ctrl+o` to open a document | ||||||
| 1. Use `ctrl+z` and `ctrl+y` to undo/redo | ||||||
| 1. Use `alt+f4` to close | ||||||
|
|
||||||
| #### Expected Results | ||||||
|
|
||||||
| * NVDA announces formatting changes and file actions | ||||||
| * Editing and formatting are accessible | ||||||
|
|
||||||
| ### 3. Reviewing and Navigation | ||||||
|
|
||||||
| #### Steps | ||||||
|
|
||||||
| 1. Use `f7` for spell check | ||||||
|
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Be aware of #17887 |
||||||
| 1. Use `ctrl+f` to open the find bar | ||||||
| 1. Use `ctrl+g` to go to a page/section | ||||||
| 1. Use `shift+f5` to return to last edit | ||||||
|
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Need to save, close and reopen a document for this to work. Also doesn't seem like NVDA is aware that the caret moves in this case. |
||||||
|
|
||||||
| #### Expected Results | ||||||
|
|
||||||
| * Spell check and navigation features are accessible | ||||||
| * NVDA announces review results and navigation targets | ||||||
|
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. This one doesn't really hold on 32 bit |
||||||
|
|
||||||
| --- | ||||||
|
|
||||||
| ## Calc Smoke Tests | ||||||
|
|
||||||
| ### 1. Launch and Basic Navigation | ||||||
|
|
||||||
| #### Steps | ||||||
|
|
||||||
| 1. Launch Calc | ||||||
| 1. Verify NVDA announces the Calc window title | ||||||
| 1. Use `ctrl+n` to create a new spreadsheet | ||||||
|
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Again, Calc automatically opens to a new workbook |
||||||
| 1. Use arrow keys to move between cells | ||||||
| 1. Use `tab` to move across cells and toolbar | ||||||
|
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Pressing
Suggested change
|
||||||
|
|
||||||
| #### Expected Results | ||||||
|
|
||||||
| * NVDA announces window title, toolbar, and cell coordinates | ||||||
| * Navigation between cells is clear and consistent | ||||||
|
|
||||||
| ### 2. Data Entry and Basic Operations | ||||||
|
|
||||||
| #### Steps | ||||||
|
|
||||||
| 1. Enter data in cells | ||||||
| 1. Use `ctrl+c` to copy, `ctrl+v` to paste, `ctrl+x` to cut | ||||||
| 1. Use `ctrl+z` and `ctrl+y` to undo/redo | ||||||
| 1. Use `ctrl+s` to save, `ctrl+o` to open a spreadsheet | ||||||
| 1. Use `alt+f4` to close | ||||||
|
|
||||||
| #### Expected Results | ||||||
|
|
||||||
| * NVDA announces data entry and clipboard actions | ||||||
|
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. It doesn't announce clipboard actions at present |
||||||
| * File operations are accessible | ||||||
|
|
||||||
| ### 3. Formulas and Navigation | ||||||
|
|
||||||
| #### Steps | ||||||
|
|
||||||
| 1. Enter a formula (e.g., `=sum(a1:a5)`) | ||||||
| 1. Use `f2` to edit a cell | ||||||
| 1. Use `ctrl+arrowKey` to jump to the edge of data regions | ||||||
|
seanbudd marked this conversation as resolved.
|
||||||
| 1. Use `ctrl+space` to select a column, `shift+space` to select a row | ||||||
|
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Only seems to be reported if there's already more than 1 cell selected
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. This should probably also include shift+arrows for selection |
||||||
|
|
||||||
| #### Expected Results | ||||||
|
|
||||||
| * NVDA announces formula entry and cell editing | ||||||
|
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. The auto suggestions when typing formulae don't seem to be accessible at present |
||||||
| * Navigation shortcuts are accessible | ||||||
|
|
||||||
| --- | ||||||
|
|
||||||
| ## Impress Smoke Tests | ||||||
|
|
||||||
| ### 1. Launch and Basic Navigation | ||||||
|
|
||||||
| #### Steps | ||||||
|
|
||||||
| 1. Launch Impress | ||||||
| 1. Verify NVDA announces the Impress window title | ||||||
| 1. Use `ctrl+n` to create a new presentation | ||||||
|
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. When I first open LO Impress, I get a new slideshow wizard. Pressing |
||||||
| 1. Use `tab` to move through the toolbar and slide area | ||||||
| 1. Use arrow keys to move between slides and within slide content | ||||||
|
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Page up and down moves between slides. Arrow keys moves the selected object on the slide |
||||||
|
|
||||||
| #### Expected Results | ||||||
|
|
||||||
| * NVDA announces window title, toolbar, and slide area | ||||||
| * Navigation is smooth and consistent | ||||||
|
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Arguably not the case at present |
||||||
|
|
||||||
| ### 2. Slide Editing and Presentation | ||||||
|
|
||||||
| #### Steps | ||||||
|
|
||||||
| 1. Type sample text on a slide | ||||||
|
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. I don't think you can type directly onto a slide; you have to type into a textbox |
||||||
| 1. Use `ctrl+m` to add a new slide | ||||||
| 1. Use `ctrl+s` to save, `ctrl+o` to open a presentation | ||||||
| 1. Use `f5` to start slideshow, `esc` to exit | ||||||
| 1. Use arrow keys to move between slides during slideshow | ||||||
|
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Nothing is currently reported when presenting in LOI |
||||||
|
|
||||||
| #### Expected Results | ||||||
|
|
||||||
| * NVDA announces slide content and transitions | ||||||
| * Editing and presenting are accessible | ||||||
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,198 @@ | ||
| # NVDA MS Office Smoke Testing Plan | ||
|
|
||
| ## Objective | ||
|
|
||
| To ensure NVDA functions correctly with Microsoft Office applications (Outlook, Word, PowerPoint, Excel) across different UIA settings and typical user workflows. | ||
| This plan focuses on basic navigation, document interaction, and accessibility of key features. | ||
|
|
||
| ## UIA Settings | ||
|
|
||
| For Word/Outlook, and Excel toggle the relevant UIA settings in Advanced Preferences. | ||
| Note: UIA support is evolving; NVDA should work optimally with the default UIA setting. | ||
|
Comment on lines
+8
to
+11
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. I'm not sure what this section is trying to communicate? |
||
|
|
||
| ## Applications Covered | ||
|
|
||
| * Outlook | ||
| * Word | ||
| * PowerPoint | ||
| * Excel | ||
|
|
||
| --- | ||
|
|
||
| ## Outlook Smoke Tests | ||
|
|
||
| ### 1. Launch and Basic Navigation | ||
|
|
||
| #### Steps | ||
|
|
||
| 1. Launch Outlook | ||
| 1. Verify NVDA announces the Outlook window title | ||
| 1. Use `ctrl+1` to switch to Mail | ||
| 1. Use `tab` and arrow keys to navigate the folder pane, message list, and reading pane | ||
|
|
||
| #### Expected Results | ||
|
|
||
| * NVDA announces window title and major panes | ||
| * Navigation between panes is clear and consistent | ||
|
|
||
| ### 2. Reading and Managing Email | ||
|
|
||
| #### Steps | ||
|
|
||
| 1. Use arrow keys to move through the message list | ||
| 1. Use `enter` to open a message | ||
| 1. Use `tab` to move through message headers and body | ||
| 1. Use `ctrl+r` to reply, `ctrl+f` to forward, `delete` to delete | ||
| 1. Use `ctrl+n` to create a new message | ||
| 1. Compose a message, use `tab` to move between fields, and `ctrl+enter` to send | ||
|
|
||
| #### Expected Results | ||
|
|
||
| * NVDA announces message subjects, senders, and content | ||
| * All message actions are accessible and announced | ||
| * Composing and sending email is accessible | ||
|
|
||
| ### 3. Calendar and Other Modules | ||
|
|
||
| #### Steps | ||
|
|
||
| 1. Use `ctrl+2` to switch to Calendar | ||
| 1. Use arrow keys to navigate the calendar | ||
| 1. Use `tab` to move between calendar views and appointments | ||
| 1. Use `ctrl+g` to go to a date | ||
| 1. Use `ctrl+1` to return to Mail | ||
|
|
||
| #### Expected Results | ||
|
|
||
| * Calendar navigation is accessible | ||
| * Appointments and views are announced | ||
|
|
||
| --- | ||
|
|
||
| ## Word Smoke Tests | ||
|
|
||
| ### 1. Launch and Document Navigation | ||
|
|
||
| #### Steps | ||
|
|
||
| 1. Launch Word | ||
| 1. Verify NVDA announces the Word window title | ||
| 1. Use `ctrl+n` to create a new document | ||
|
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Behaviour of this depends on "Show the Start screen when this application starts"
|
||
| 1. Use `tab` to move through the ribbon and document area | ||
|
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Pressing |
||
| 1. Use arrow keys to move through the document | ||
|
|
||
| #### Expected Results | ||
|
|
||
| * NVDA announces window title, ribbon, and document area | ||
| * Navigation is smooth and consistent | ||
|
|
||
| ### 2. Basic Editing and Formatting | ||
|
|
||
| #### Steps | ||
|
|
||
| 1. Type sample text | ||
|
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Possibly noting that typing |
||
| 1. Use `ctrl+b` to bold, `ctrl+i` to italic, `ctrl+u` to underline | ||
| 1. Use `ctrl+s` to save, `ctrl+o` to open a document | ||
| 1. Use `ctrl+z` and `ctrl+y` to undo/redo | ||
| 1. Use `alt+f4` to close | ||
|
|
||
| #### Expected Results | ||
|
|
||
| * NVDA announces formatting changes and file actions | ||
| * Editing and formatting are accessible | ||
|
|
||
| ### 3. Reviewing and Navigation | ||
|
|
||
| #### Steps | ||
|
|
||
| 1. Use `f7` for spell check | ||
| 1. Use `ctrl+f` to open the navigation pane | ||
| 1. Use `ctrl+g` to go to a page/section | ||
| 1. Use `shift+f5` to return to last edit | ||
|
|
||
| #### Expected Results | ||
|
|
||
| * Spell check and navigation features are accessible | ||
| * NVDA announces review results and navigation targets | ||
|
|
||
| --- | ||
|
|
||
| ## PowerPoint Smoke Tests | ||
|
|
||
| ### 1. Launch and Basic Navigation | ||
|
|
||
| #### Steps | ||
|
|
||
| 1. Launch PowerPoint | ||
| 1. Verify NVDA announces the PowerPoint window title | ||
| 1. Use `ctrl+n` to create a new presentation | ||
|
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Moves to new section of backstage view if open, otherwise creates and opens new presentation. |
||
| 1. Use `tab` to move through the ribbon and slide area | ||
|
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Within a slide, |
||
| 1. Use arrow keys to move between slides and within slide content | ||
|
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Behaviour of arrow keys is very context dependent.
|
||
|
|
||
| #### Expected Results | ||
|
|
||
| * NVDA announces window title, ribbon, and slide area | ||
| * Navigation is smooth and consistent | ||
|
|
||
| ### 2. Slide Editing and Presentation | ||
|
|
||
| #### Steps | ||
|
|
||
| 1. Type sample text on a slide | ||
|
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. You can't type directly onto a slide. The only situations I've been able to get typing directly to work are:
I think this should be reworded to be a bit more specific. I.E. talk about tabbing to the title shape and typing into it. |
||
| 1. Use `ctrl+m` to add a new slide | ||
| 1. Use `ctrl+s` to save, `ctrl+o` to open a presentation | ||
| 1. Use `f5` to start slideshow, `esc` to exit | ||
| 1. Use arrow keys to move between slides during slideshow | ||
|
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Arrow keys don't move between slides with NVDA on; they review the contents of the slide. |
||
|
|
||
| #### Expected Results | ||
|
|
||
| * NVDA announces slide content and transitions | ||
|
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. What do you mean "NVDA announces [...] transitions"? |
||
| * Editing and presenting are accessible | ||
|
|
||
| --- | ||
|
|
||
| ## Excel Smoke Tests | ||
|
|
||
| ### 1. Launch and Basic Navigation | ||
|
|
||
| #### Steps | ||
|
|
||
| 1. Launch Excel | ||
| 1. Verify NVDA announces the Excel window title | ||
| 1. Use `ctrl+n` to create a new workbook | ||
|
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. New page of backstage view is shown if same is open; creates new workbook otherwise. |
||
| 1. Use arrow keys to move between cells | ||
| 1. Use `tab` to move across cells and ribbon | ||
|
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
|
||
|
|
||
| #### Expected Results | ||
|
|
||
| * NVDA announces window title, ribbon, and cell coordinates | ||
| * Navigation between cells is clear and consistent | ||
|
|
||
| ### 2. Data Entry and Basic Operations | ||
|
|
||
| #### Steps | ||
|
|
||
| 1. Enter data in cells | ||
| 1. Use `ctrl+c` to copy, `ctrl+v` to paste, `ctrl+x` to cut | ||
| 1. Use `ctrl+z` and `ctrl+y` to undo/redo | ||
| 1. Use `ctrl+s` to save, `ctrl+o` to open a workbook | ||
| 1. Use `alt+f4` to close | ||
|
|
||
| #### Expected Results | ||
|
|
||
| * NVDA announces data entry and clipboard actions | ||
| * File operations are accessible | ||
|
|
||
| ### 3. Formulas and Navigation | ||
|
|
||
| #### Steps | ||
|
|
||
| 1. Enter a formula (e.g., `=sum(a1:a5)`) | ||
| 1. Use `f2` to edit a cell | ||
| 1. Use `ctrl+arrowKey` to jump to the edge of data regions | ||
|
seanbudd marked this conversation as resolved.
|
||
| 1. Use `ctrl+space` to select a column, `shift+space` to select a row | ||
|
|
||
| #### Expected Results | ||
|
|
||
| * NVDA announces formula entry and cell editing | ||
| * Navigation shortcuts are accessible | ||
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Not sure if it's just my settings, but you're already in a blank document when you open Writer