Add manual smoke test plans for MS Office, Libre Office, Web Browsers, IDEs #18419

seanbudd · 2025-07-07T03:15:09Z

Creates smoke test plans for MS office, Libre Office, IDEs and Web browsers to help test against regressions when migrating to 64bit

Copilot

Pull Request Overview

This PR adds manual smoke test plans to ensure NVDA functionality across MS Office, LibreOffice, and major web browsers when migrating to 64-bit.

Introduce a comprehensive smoke test plan for web browsers (Chrome, Edge, Firefox).
Add smoke test plans for Microsoft Office applications (Outlook, Word, PowerPoint, Excel).
Add smoke test plans for LibreOffice applications (Writer, Calc, Impress).

Reviewed Changes

Copilot reviewed 3 out of 3 changed files in this pull request and generated 2 comments.

File	Description
tests/manual/applications/webBrowsers.md	Add smoke test plan for major web browsers
tests/manual/applications/msOffice.md	Add smoke test plan covering MS Office applications
tests/manual/applications/libreOffice.md	Add smoke test plan for LibreOffice applications

Comments suppressed due to low confidence (2)

tests/manual/applications/webBrowsers.md:62

The link path for the Forms example appears to reference the landmarks directory; update it to the correct patterns/form/examples path to match other ARIA sample links.

* [Forms](../../../include/w3c-aria-practices/content/patterns/landmarks/examples/form.html)

tests/manual/applications/libreOffice.md:1

[nitpick] Consider adding a UIA Settings section (similar to the MS Office plan) to specify required UIA toggles for LibreOffice, ensuring consistency across all manual test plans.

# NVDA LibreOffice Smoke Testing Plan

tests/manual/applications/msOffice.md

tests/manual/applications/libreOffice.md

AppVeyorBot · 2025-07-07T03:56:46Z

PASS: Translation comments check.
PASS: License check.
PASS: Unit tests.
FAIL: System tests (tags: installer NVDA). See test results for more information.
Build (for testing PR): https://ci.appveyor.com/api/buildjobs/haha5c1g3pk5iw5x/artifacts/output/nvda_snapshot_pr18419-37177,43168a55.exe
CI timing (mins):
INIT 0.0,
INSTALL_START 1.5,
INSTALL_END 0.9,
BUILD_START 0.0,
BUILD_END 17.4,
TESTSETUP_START 0.0,
TESTSETUP_END 0.4,
TEST_START 0.0,
TEST_END 20.2,
FINISH_END 0.1

See test results for failed build of commit 43168a5564

SaschaCowley

Partial review

SaschaCowley · 2025-07-08T05:30:05Z

tests/manual/applications/IDEs/jetBrains.md

+
+### Steps
+
+1. Use `ctrl+f` to search within the current file


You already had us do that in Editor Accessibility step 3

SaschaCowley · 2025-07-08T05:31:17Z

tests/manual/applications/IDEs/jetBrains.md

+
+1. Use `ctrl+f` to search within the current file
+1. Use `ctrl+shift+f` to search across the project
+1. Use `ctrl+shift+n` to find any file, class, or symbol


You said ctrl+shift+n creates a new project in Project Operations step 1.

SaschaCowley · 2025-07-08T05:33:01Z

tests/manual/applications/IDEs/jetBrains.md

+1. Use `ctrl+shift+f` to search across the project
+1. Use `ctrl+shift+n` to find any file, class, or symbol
+1. Use `ctrl+n` to find a class
+1. Use `ctrl+shift+n` to find a file


You already had us use ctrl+shift+n to "find any file, class, or symbol"

SaschaCowley · 2025-07-08T05:36:31Z

tests/manual/applications/IDEs/jetBrains.md

+
+1. Use `ctrl+alt+s` to open Settings/Preferences
+1. Navigate through settings categories using arrow keys
+1. Use `ctrl+alt+s` to open Plugins settings


You already had us use ctrl+alt+s to open settings

SaschaCowley · 2025-07-08T05:38:50Z

tests/manual/applications/IDEs/jetBrains.md

Not a JetBrains user, so some of these comments may be obvious to experienced JetBrains users

SaschaCowley · 2025-07-08T06:02:33Z

tests/manual/applications/IDEs/visualStudio.md

+1. Type and navigate code in the editor using arrow keys
+1. Use `ctrl+home` and `ctrl+end` to jump to start/end of file
+1. Use `ctrl+f` to open the find dialog and search for text
+1. Use `ctrl+h` to open the replace dialog


Has actually using text replacement intentionally been omitted?

SaschaCowley · 2025-07-08T06:04:52Z

tests/manual/applications/IDEs/visualStudio.md

+
+### Steps
+
+1. Use `ctrl+f` to search within the current file


Already done in Code Editor Accessibility

SaschaCowley · 2025-07-08T06:06:25Z

tests/manual/applications/IDEs/visualStudio.md

Not a Visual Studio user, so some of these questions/comments may be obvious to experienced users.

SaschaCowley · 2025-07-21T01:20:09Z

tests/manual/applications/msOffice.md

Not yet reviewed

SaschaCowley · 2025-07-21T01:20:17Z

tests/manual/applications/webBrowsers.md

Not yet reviewed

SaschaCowley · 2025-07-28T02:00:05Z

tests/manual/applications/IDEs/vsCodium.md

+1. Verify NVDA announces the VSCodium window title
+1. Use `ctrl+shift+p` to open the command palette
+1. Use `ctrl+tab` to switch between open files/tabs
+1. Use `ctrl+b` to toggle the sidebar


Not sure about in Codium, but in VS Code Ctrl+B doesn't announce anything, unless you're focused in the sidebar, in which case you'll hear something because the focus moves.

As of VS Code 1.103.0 showing and hiding the primary and secondary sidebars is now announced.

SaschaCowley · 2025-07-28T02:01:34Z

tests/manual/applications/IDEs/vsCodium.md

+1. Use `ctrl+b` to toggle the sidebar
+1. Use `f1` to open the command palette (alternative)
+1. Use `ctrl+shift+e` to focus the Explorer
+1. Use `ctrl+shift+f` to focus the Search panel


Suggested change

1. Use `ctrl+shift+f` to focus the Search panel

1. Use `ctrl+shift+f` to focus the Search panel

1. Use `f6` to navigate between sections of the window.

SaschaCowley · 2025-07-28T02:04:41Z

tests/manual/applications/IDEs/vsCodium.md

+
+### Expected Results
+
+* NVDA announces line numbers, text, and search results


I don't think we support reporting line numbers in Monaco

SaschaCowley · 2025-07-28T02:11:57Z

tests/manual/applications/IDEs/vsCodium.md

+
+1. Use ``ctrl+` `` to open the integrated terminal
+1. Type commands and review output
+1. Use `ctrl+shift+\` to create a new terminal


Suggested change

1. Use `ctrl+shift+\` to create a new terminal

1. Use ``ctrl+shift+` `` to create a new terminal

SaschaCowley · 2025-07-28T02:14:00Z

tests/manual/applications/IDEs/vsCodium.md

+1. Use ``ctrl+` `` to open the integrated terminal
+1. Type commands and review output
+1. Use `ctrl+shift+\` to create a new terminal
+1. Use `ctrl+tab` to switch between terminal and editor


Personally, I would not switch this way. I'd use ctrl+1 to switch back to editor group 1.

SaschaCowley · 2025-07-28T02:17:36Z

tests/manual/applications/IDEs/vsCodium.md

+### Steps
+
+1. Use ``ctrl+` `` to open the integrated terminal
+1. Type commands and review output


Possibly worth noting that you can use alt+f2 or ctrl+upArrow to enter accessible view to review terminal output, and esc or ctrl+downArrow (on the last line of output) to close it

SaschaCowley · 2025-08-05T03:01:04Z

tests/manual/applications/libreOffice.md

+
+1. Launch Writer
+1. Verify NVDA announces the Writer window title
+1. Use `ctrl+n` to create a new document


Not sure if it's just my settings, but you're already in a blank document when you open Writer

SaschaCowley · 2025-08-05T03:01:35Z

tests/manual/applications/libreOffice.md

+1. Launch Writer
+1. Verify NVDA announces the Writer window title
+1. Use `ctrl+n` to create a new document
+1. Use `tab` to move through the toolbar and document area


This will just insert tabs into the document

Suggested change

1. Use `tab` to move through the toolbar and document area

1. Use `f6` and `tab` to move through the toolbar and document area

SaschaCowley · 2025-08-05T04:32:03Z

tests/manual/applications/libreOffice.md

+
+#### Steps
+
+1. Type sample text


Is it worth mentioning that you can get some sample text to work with by typing "DT" or "LOREM" followed by f3?

SaschaCowley · 2025-08-05T05:01:00Z

tests/manual/applications/libreOffice.md

+1. Use `f7` for spell check
+1. Use `ctrl+f` to open the find bar
+1. Use `ctrl+g` to go to a page/section
+1. Use `shift+f5` to return to last edit


Need to save, close and reopen a document for this to work. Also doesn't seem like NVDA is aware that the caret moves in this case.

SaschaCowley · 2025-08-05T05:03:00Z

tests/manual/applications/libreOffice.md

+
+#### Steps
+
+1. Use `f7` for spell check


Be aware of #17887

SaschaCowley · 2025-08-05T05:53:37Z

tests/manual/applications/libreOffice.md

+
+1. Launch Impress
+1. Verify NVDA announces the Impress window title
+1. Use `ctrl+n` to create a new presentation


When I first open LO Impress, I get a new slideshow wizard. Pressing Ctrl+N in this window has no effect.

SaschaCowley · 2025-08-05T06:08:07Z

tests/manual/applications/libreOffice.md

+1. Verify NVDA announces the Impress window title
+1. Use `ctrl+n` to create a new presentation
+1. Use `tab` to move through the toolbar and slide area
+1. Use arrow keys to move between slides and within slide content


Page up and down moves between slides. Arrow keys moves the selected object on the slide

SaschaCowley · 2025-08-05T06:08:31Z

tests/manual/applications/libreOffice.md

+#### Expected Results
+
+* NVDA announces window title, toolbar, and slide area
+* Navigation is smooth and consistent


Arguably not the case at present

SaschaCowley · 2025-08-05T06:21:34Z

tests/manual/applications/libreOffice.md

+
+#### Steps
+
+1. Type sample text on a slide


I don't think you can type directly onto a slide; you have to type into a textbox

SaschaCowley · 2025-08-05T06:23:45Z

tests/manual/applications/libreOffice.md

+1. Use `ctrl+m` to add a new slide
+1. Use `ctrl+s` to save, `ctrl+o` to open a presentation
+1. Use `f5` to start slideshow, `esc` to exit
+1. Use arrow keys to move between slides during slideshow


Nothing is currently reported when presenting in LOI

Add smoke tests for MS Office, Libre OFfice and Web Browsers

2488e97

Copilot AI review requested due to automatic review settings July 7, 2025 03:15

seanbudd requested a review from a team as a code owner July 7, 2025 03:15

seanbudd requested a review from SaschaCowley July 7, 2025 03:15

Copilot AI reviewed Jul 7, 2025

View reviewed changes

tests/manual/applications/msOffice.md Show resolved Hide resolved

tests/manual/applications/libreOffice.md Show resolved Hide resolved

seanbudd added 3 commits July 7, 2025 14:03

fix heading

c099bbd

Add IDEs

f209a40

remove junk

a9477ff

seanbudd changed the title ~~Add manual smoke test plans for MS Office, Libre Office and Web Browsers~~ Add manual smoke test plans for MS Office, Libre Office, Web Browsers, IDEs Jul 7, 2025

SaschaCowley added the conceptApproved Similar 'triaged' for issues, PR accepted in theory, implementation needs review. label Jul 15, 2025

SaschaCowley reviewed Jul 21, 2025

View reviewed changes

SaschaCowley reviewed Jul 28, 2025

View reviewed changes

SaschaCowley reviewed Aug 5, 2025

View reviewed changes

	1. Use `ctrl+shift+f` to focus the Search panel
	1. Use `ctrl+shift+f` to focus the Search panel
	1. Use `f6` to navigate between sections of the window.


		### Expected Results

		* NVDA announces line numbers, text, and search results

	1. Use `ctrl+shift+\` to create a new terminal
	1. Use ``ctrl+shift+` `` to create a new terminal

	1. Use `tab` to move through the toolbar and document area
	1. Use `f6` and `tab` to move through the toolbar and document area

Uh oh!

Add manual smoke test plans for MS Office, Libre Office, Web Browsers, IDEs #18419

Are you sure you want to change the base?

Add manual smoke test plans for MS Office, Libre Office, Web Browsers, IDEs #18419

Uh oh!

Conversation

seanbudd commented Jul 7, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull Request Overview

Reviewed Changes

Uh oh!

Uh oh!

Uh oh!

AppVeyorBot commented Jul 7, 2025

Uh oh!

SaschaCowley left a comment

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

seanbudd commented Jul 7, 2025 •

edited

Loading