• PSA/QUESTION: Porting Windows batch to Python for macOS/Linux users

    From Maria Sophia@mariasophia@comprehension.com to comp.lang.python,alt.os.linux,comp.sys.mac.system,alt.comp.os.windows-11 on Sat Nov 21 16:23:36 2026
    From Newsgroup: alt.comp.os.windows-11

    The PSA is I intend to create and post a port of a Windows batch script I wrote yesterday when creating an Android homescreen-archival capability.

    Newsgroups: comp.mobile.android,alt.comp.os.windows-10,alt.msdos.batch
    Subject: Can we programmatically get package names of icons in a homescreen folder?
    Date: Thu, 19 Nov 2026 16:06:21 -0400
    Message-ID: <11dnkrt$2pjn$1@nnrp.usenet.blueworldhosting.com>

    But, first, the QUESTION is what is the best/easiest/simplest/etc., way you would suggest I port from a working Windows batch script to Python?

    Since it isn't ported yet, below is a description of what the script does.

    The cross-platform porting question is:

    Q: What is the easiest/safest/most-portable/etc. way to port to Python?
    A: ?

    ====< below is just a description of what the batch file does >=====
    :: -------------------------------------------------------------------------
    :: adbfolder.bat
    :: -------------------------------------------------------------------------
    :: Outputs a perfect textual inventory, with debug capability, of an Android
    :: homescreen, including location of all panes, folders, packages and titles.
    ::
    :: Intended to assist in debugging, inventory, archival, backup and restore.
    :: Runs on Windows over Wi-Fi/USB, but can be ported to other platforms.
    ::
    :: Will pull a backup from android via adb or read an existing nova db or
    :: nova backup archive on windows needing only adb and sql dependencies
    ::
    :: List order is top to bottom, left to right, meaning the leftmost pane
    :: is 1st, the topleft folder is 1st, then the next folder to the right.
    ::
    :: Likewise, packages and titles inside of folders are listed in top to
    :: bottom order, left to right, providing an exact textual description.
    ::
    :: Bare icons, not inside folders, are listed separately as a line item.
    ::
    :: This script not only provides a complete inventory of every package
    :: and title of every folder & icon on the homescreen, but it optionally
    :: will 'diff' against all packages installed by the user to indicate
    :: 'headless' apps which are installed, but which have no homescreen icon.
    ::
    :: Note the display_name is the current icon title for a given app icon,
    :: which can be changed by the user, so it's not always the original.
    :: However, for apps installed by the user but without homescreen icons,
    :: the optional lookup pulls the app's original defined Android app_label.
    ::
    :: Output is appended to a timestamped running-log file for inventory use.
    :: -------------------------------------------------------------------------
    :: v5p9 20261121 Reformatted folder and pane output with a descriptive
    :: heading and two-space indentation, and added a timestamped
    :: running log file that accumulates formatted exports
    :: v5p8 20261121 Renamed app_title output column to display_name to
    :: distinguish the current homescreen icon title from the
    :: original Android application label and reformatted output
    :: v5p7 20261121 Moved the restore option to the local-file-path section
    :: v5p6 20261121 Improved comments and explanations and user prompts
    :: v5p5 20261120 Added option to open Nova Launcher settings on the device
    :: to create a fresh homescreen backup before listing/pulling
    :: v5p4 20261120 Appended a step-by-step flow description at the bottom
    :: v5p3 20261120 Fixed too many syntax issues to count between versions
    :: Moved per-pane scanning into a :scan_pane subroutine and
    :: cleaned up SQL/batch parsing in the pane loop so menu
    :: scanning runs without cmd.exe syntax errors
    :: v4p5 20261119 Fixed loose apps package_name extraction in :run_query
    :: when component= has no slash or uses package=
    :: v4p4 20261119 Replaced "filter" / "filtered" in comments with what the
    :: code actually does
    :: v4p3 20261119 Kept loose apps with all item types except itemType != 2 and
    :: removed parentheses from comment lines across the script
    :: v4p2 20261119 Removed extra iconPackage/component= check on loose apps
    :: so all non-folder items itemType != 2 on a pane are
    :: included without dropping rows
    :: v4p1 20261119 Restricted loose apps count and query to items that have a
    :: non-empty iconPackage or component= in intent while keeping
    :: all existing behavior, comments, and formatting intact
    :: v4p0 20261119 Gave up on trying to eliminate empty lines from PowerShell
    :: in the optional orphan-packages-with-no-launch icon listing
    :: so v4p0 is an exact duplicate of v3p6 which has blank lines
    :: v3p9 20261119 Moved menu scanning, SQLite querying, table formatting,
    :: and unplaced -3 package diffing into a dedicated PowerShell
    :: engine script so cmd.exe never hits block/caret/quote errors
    :: and fixed looseapps condition to itemType <> 2 and set DEBUG=0
    :: v3p8 20261119 Formatted unplaced user app table directly in PS_DIFF_3P
    :: instead of Format-Table to remove blank lines between rows
    :: v3p7 20261119 Fixed missing package_name in :run_query by replacing !=
    :: with LENGTH/TRIM checks and guarding SUBSTR against missing
    :: slashes and fixed pane loose apps SQL_WHERE to f.itemType <> 2
    :: v3p6 20261119 Added optional prompt before resolving Nova f.title names
    :: in check_missing_3p and printed periodic progress while
    :: resolving labels so quick checks finish immediately
    :: v3p5 20261119 Removed stray caret escaping before closing parentheses on
    :: standalone PS_DIFF_3P echo lines so PowerShell parses the
    :: generated script cleanly, and kept DEBUG=1 enabled
    :: v3p4 20261119 Added app label lookup via adb dumpsys and optional aapt/aapt2
    :: for unplaced user apps in check_missing_3p and set DEBUG=0
    :: as the default flag
    :: v3p3 20261119 Replaced != with LENGTH/TRIM checks in Nova package SQL
    :: query so cmd delayed expansion does not strip negation
    :: and handled component= values without a slash safely
    :: v3p2 20261119 Wrote Nova package SQL query to a temp .sql file to avoid
    :: cmd parsing syntax errors and wrote PS_DIFF_3P line-by-line
    :: instead of using an outer parenthesized block
    :: v3p1 20261119 Insrumented the orphan section as it was throwing errors
    :: v3p0 20261119 Fixed command syntax error when generating the PowerShell
    :: diff script in check_missing_3p and wrapped the Nova
    :: package query in a subquery so package_name matches cleanly
    :: v2p9 20261119 Added a final sanity check before quitting to compare
    :: the list of packages that have icons on the homescreen
    :: against all the user-installed packages on the phone
    :: to create an orphan-packages file that have no icons
    :: v2p8 20261119 Added quit option at folder selection prompt and loop back
    :: prompt at end to export another folder or pane
    :: v2p7 20261119 Replaced fragile DISTINCT screen loop with explicit pane
    :: index pass 0 to 9 using CAST screen AS INTEGER so panes
    :: with folders or loose apps always appear in order
    :: v2p6 20261119 Fixed pane screen query so folders on pane 0, pane 1 and
    :: pane 2 display properly along with loose pane apps and other
    :: v2p5 20261119 Grouped folders by screen number across panes and kept
    :: unmatched folders under other at the bottom
    :: v2p4 20261119 Added loose apps choice at the end of each pane with
    :: non-folder items and kept other catch-all at the bottom
    :: v2p3 20261119 Listed folders under dock and each pane with no default
    :: and skipped empty sections
    :: v2p2 20261119 Added full-layout option outputting dock and pane headers
    :: with package_name and app_title lines
    :: v2p1 20261119 Replaced backtick for /f calls on DOCK_TOTAL and PANE_TOTAL
    :: with temp file redirects so cmd reliably captures counts
    :: v2p0 20261119 Removed ampersand and parenthesis inside comment labels
    :: as labels are not comments even though they act like them
    :: v1p9 20261119 Removed item_type column from output and grouped folders
    :: by their homescreen pane eg, "Pane 0 Folder: weather"
    :: v1p8 20261119 Dynamically lists dock, eg, container = -101, and lists
    :: homescreen panes by screen number, eg, container = -100,
    :: and by named folders eg, itemType = 2, from nova db
    :: and includes item_type in output
    :: v1p7 20261119 Searches android storage for * novabackup files when none
    :: are found in ANDROID_BCK_DIR, storing full remote paths so
    :: backups in any folder can be pulled cleanly
    :: v1p6 20261119 Set DEBUG=0 by default for clean normal output while keeping
    :: the toggle available for troubleshooting
    :: v1p5 20261119 Reversed output columns to package_name first, app_title
    :: second and added startup dependency check for adb and
    :: sqlite3 dependency checking configured paths and PATH
    :: v1p4 20261119 Moved powershell commands into %TEMP%\* ps1 scripts run via
    :: "-File" instead of backticks so cmd never parses "<" or ">"
    :: v1p3 20261119 Added DEBUG=1 instrumentation
    :: v1p2 20261119 Replaced cmd FOR sanitizer with powershell
    :: v1p1 20261119 Numbered selection menu for novabackup files, lists folders
    :: by name with numbered selection instead of raw container IDs
    :: v1p0 20261119 Initial version to pull backup or use local nova db, query
    :: sql via sqlite3 exe, select columns with powershell
    :: -------------------------------------------------------------------------
    ... snip code ...
    :: -------------------------------------------------------------------------
    :: Step by step description of what this script does
    :: 1. Environment & Configuration Setup
    :: A. Command environment
    :: a. Disables command echoing and enables delayed expansion
    :: b. Sets the working directory to the script's path
    :: B. Configuration variables
    :: a. Sets default configuration paths for ADB, SQLite
    :: and work directories
    :: b. Defines the DEBUG toggle flag
    :: 2. Dependency Verification
    :: A. Executable checks
    :: a. Locates adb.exe and checks system PATH or configured fallback path
    :: b. Locates sqlite3.exe and exits with an error if missing
    :: B. Directory setup
    :: a. Creates the local working directory if it does not exist
    :: 3. Source Selection Menu
    :: A. Choice [1]: Pull from Android via ADB
    :: a. Detects connected ADB device target
    :: b. Lists .novabackup files in the remote backup directory
    :: with fallback search
    :: c. Prompts user to select or enter a backup filename/path
    :: d. Pulls the selected .novabackup file to the Windows workspace
    :: e. Renames the pulled file to backup.zip and extracts it
    :: into backup_extracted to retrieve nova.db
    :: B. Choice [2]: Use Local Database / Archive
    :: a. Prompts user for a custom path to nova.db .novabackup or .zip
    :: with a retry loop
    :: b. Validates file existence
    :: c. Automatically extracts archives if .novabackup or .zip file
    :: 4. Database Verification & Target Enumeration
    :: A. Database validation
    :: a. Verifies that nova.db exists at the target path
    :: B. Section 1 [Dock]
    :: a. Scans dock apps [container = -101]
    :: b. Scans and lists any dock folders
    :: C. Section 2 [Panes 0-14]
    :: a. Iterates through home screen panes 0 to 14
    :: via the scan_pane subroutine
    :: b. Queries pane folders [itemType = 2, container = -100]
    :: c. Checks for loose non-folder apps [itemType <> 2] on the pane
    :: D. Section 3 [Other Folders]
    :: a. Searches for orphaned folders not categorized under dock or panes
    :: b. Lists and registers valid other folders
    :: 5. User Selection & Query Execution [run_query]
    :: A. Selection & Sanity
    :: a. Prompts user to select a target number or quit [q or 0]
    :: b. Sanitizes the selected label using a temporary PowerShell
    :: script to generate a safe filename
    :: B. Query Generation & Execution
    :: a. Writes a dynamic SQLite query script to a temp file
    :: [.sql] extracting item ID, app title, package name and raw intent
    :: b. Executes the query against nova.db using sqlite3.exe
    :: C. Output & Formatting
    :: a. Formats output columns [package_name first, display_name second]
    :: into an auto-sized table via PowerShell
    :: b. Adds a descriptive pane/folder heading and indents the table
    :: by two spaces for easier reading and future concatenation
    :: c. Saves raw results [output.txt] and formatted results
    :: [target_apps.txt] to the work directory
    :: d. Appends each formatted export with a timestamp to
    :: [adbfolder_log.txt] without overwriting previous exports
    :: e. Prompts user to loop back to scan another folder/pane or proceed
    :: 6. Optional Unplaced Third-Party Package Check [check_missing_3p]
    :: A. Pre-check Validation
    :: a. Prompts user whether to check for user-installed packages
    :: [-3] missing from the Nova layout
    :: b. Verifies ADB device connectivity and database availability
    :: c. Optionally prompts user to resolve app labels via adb dumpsys
    :: and aapt/aapt2
    :: B. Data Collection
    :: a. Queries installed third-party packages from device
    :: [adb shell pm list packages -3]
    :: b. Queries all referenced packages inside nova.db
    :: C. Diff Analysis & Cleanup
    :: a. Generates and executes a PowerShell diff script to find
    :: installed packages with no home screen icon
    :: b. Outputs a formatted table of unplaced apps to
    :: unplaced_user_apps.txt
    :: c. Cleans up temporary script and text files
    :: [unless DEBUG=1] and exits cleanly
    :: -------------------------------------------------------------------------
    :: Not only is there a question of how to port this for more general use,
    :: but there's also a question of which common launchers will it work with.
    ::
    :: It may be that the native Android launcher may provide a 'parsable
    :: homescreen, so I looked up which might work in addition to Nova Launcher.
    ::
    :: So far, I "think" [tentatively] these will export/import a homescreen.
    :: a. Nova [SQL, .novabackup/nova.db restore]
    :: b. Lawnchair [.lawnchairbackup/restore]
    :: c. Mink [JSON backup/restore]
    :: d. Total Launcher [zip? backup/restore]
    :: e. Niagra [nlb backup/restore]
    :: d. Others? [SQLite, JSON, XML, etc.]
    :: ------------------------------------------------------------------------
    --
    On Usenet, we can pool our knowledge and skills so everyone learns more.
    --- Synchronet 3.22a-Linux NewsLink 1.2
  • From Maria Sophia@mariasophia@comprehension.com to comp.lang.python,alt.os.linux,comp.sys.mac.system,alt.comp.os.windows-11 on Sat Nov 21 22:32:45 2026
    From Newsgroup: alt.comp.os.windows-11

    It turned out to only take about a half-dozen iterations to port the
    Windows batch script to a working python script that I tested on Windows.

    For some background, yesterday I need to know the weather apps that were in
    my desktop weather folder 'cuz I wanted to test which were the best to
    predict the atmospheric river that dumped a foot of water into my pool.

    I figured it would take about an hour, but of course, it took longer. Thankfully, after about 61 iterations, it was working to my satisfaction.

    Here's the v6p1 Windows batch script which worked how I wanted it to.
    I'll post the python port next. And then a comparison of the outputs.

    :: -------------------------------------------------------------------------
    :: adbfolder.bat
    :: -------------------------------------------------------------------------
    :: Outputs a perfect textual inventory, with debug capability, of an Android
    :: homescreen, including location of all panes, folders, packages and titles.
    ::
    :: Intended to assist in debugging, inventory, archival, backup and restore.
    :: Runs on Windows over Wi-Fi/USB, but can be ported to other platforms.
    ::
    :: Will pull a backup from android via adb or read an existing nova db or
    :: nova backup archive on windows needing only adb and sql dependencies
    ::
    :: List order is top to bottom, left to right, meaning the leftmost pane
    :: is 1st, then subsequent panes, from 0 to 1 to 2 and so on to the right.
    ::
    :: Similarly, the topleft folder is 1st, then the next folder to the right.
    ::
    :: Likewise, packages and titles inside of folders are listed in top to
    :: bottom order, left to right, providing an exact textual description.
    ::
    :: Bare icons, not inside folders, are listed separately as a line item.
    :: The dock and folders in the dock are treated much like the panes are.
    ::
    :: This script not only provides a textual inventory of the name and
    :: homescreen location of every folder name, package name and display
    :: name ever added to the homescreen, but it optionally will 'diff'
    :: against packages which were manually installed by the user but
    :: which have no current homescreen icon (i.e., "headless" apps).
    ::
    :: Note the display_name is the current icon title for a given app icon,
    :: which can be changed by the user, so it's not always the original.
    :: However, for apps installed by the user but without homescreen icons,
    :: the optional lookup pulls the app's original defined Android app_label.
    ::
    :: Output is appended to a timestamped running log file for traceability.
    :: Unless the user wipes out the running log, this becomes an automatic
    :: audit of all the physical changes a user has made to the homescreen.
    :: -------------------------------------------------------------------------
    :: Q: Why is saying YES to "Resolve app titles via adb/aapt" very slow?
    :: A: For each of the unplaced packages, the script does:
    :: a. adb shell dumpsys package <pkg> to look for nonLocalizedLabel=
    :: b. If that fails: adb shell pm path <pkg> to find the APK location
    :: c. adb pull <apk> to download the APK to the PC
    :: d. aapt dump badging <apk> to read the app label from the APK
    :: Which is up to 4 ADB commands times N apps = 4N round-trips.
    :: Over USB, each round-trip is fast (milliseconds).
    :: But, over Wi-Fi, each one has wireless handshake latency,
    :: so the total time adds up just waiting on ADB to return results.
    :: -------------------------------------------------------------------------
    :: v6p1 20261121 Ported to adbfolder.py v1p6 (took a half-dozen iterations)
    :: Matched outpout of abfolder.bat v6p1 with adbfolder.py v1p6
    :: v6p0 20261121 Fixed ADB shell ls wildcard expansion by moving the closing
    :: quote after %ANDROID_BCK_DIR% so *.novabackup is not treated
    :: as a literal filename (which had forced a global search)
    :: v5p9 20261121 Reformatted folder and pane output with a descriptive
    :: heading and two-space indentation, and added a timestamped
    :: running log file that accumulates formatted exports
    :: v5p8 20261121 Renamed app_title output column to display_name to
    :: distinguish the current homescreen icon title from the
    :: original Android application label and reformatted output
    :: v5p7 20261121 Moved the restore option to the local-file-path section
    :: v5p6 20261121 Improved comments and explanations and user prompts
    :: v5p5 20261120 Added option to open Nova Launcher settings on the device
    :: to create a fresh homescreen backup before listing/pulling
    :: v5p4 20261120 Appended a step-by-step flow description at the bottom
    :: v5p3 20261120 Moved per-pane scanning into a :scan_pane subroutine and
    :: cleaned up SQL/batch parsing in the pane loop so menu
    :: scanning runs without cmd.exe syntax errors
    :: v5p2 20261120 Fixed too many individual syntax problems to count between
    :: the last dozen versions, which were Windows CLI issues
    :: v4p5 20261119 Fixed loose apps package_name extraction in :run_query
    :: when component= has no slash or uses package=
    :: v4p4 20261119 Improved comments regarding filtering of the output data
    :: v4p3 20261119 Kept loose apps with all item types except itemType != 2 and
    :: removed parentheses from comment lines across the script
    :: v4p2 20261119 Removed extra iconPackage/component= check on loose apps
    :: so all non-folder items itemType != 2 on a pane are
    :: included without dropping rows
    :: v4p1 20261119 Restricted loose apps count and query to items that have a
    :: non-empty iconPackage or component= in intent while keeping
    :: all existing behavior, comments, and formatting intact
    :: v4p0 20261119 Gave up on trying to eliminate empty lines from PowerShell
    :: in the optional orphan-packages-with-no-launch icon listing
    :: so v4p0 is an exact duplicate of v3p6 which has blank lines
    :: v3p9 20261119 Moved menu scanning, SQLite querying, table formatting,
    :: and unplaced -3 package diffing into a dedicated PowerShell
    :: engine script so cmd.exe never hits block/caret/quote errors
    :: and fixed looseapps condition to itemType <> 2 and set DEBUG=0
    :: v3p8 20261119 Formatted unplaced user app table directly in PS_DIFF_3P
    :: instead of Format-Table to remove blank lines between rows
    :: v3p7 20261119 Fixed missing package_name in :run_query by replacing !=
    :: with LENGTH/TRIM checks and guarding SUBSTR against missing
    :: slashes and fixed pane loose apps SQL_WHERE to f.itemType <> 2
    :: v3p6 20261119 Added optional prompt before resolving Nova f.title names
    :: in check_missing_3p and printed periodic progress while
    :: resolving labels so quick checks finish immediately
    :: v3p5 20261119 Removed stray caret escaping before closing parentheses on
    :: standalone PS_DIFF_3P echo lines so PowerShell parses the
    :: generated script cleanly, and kept DEBUG=1 enabled
    :: v3p4 20261119 Added app label lookup via adb dumpsys and optional aapt/aapt2
    :: for unplaced user apps in check_missing_3p and set DEBUG=0
    :: as the default flag
    :: v3p3 20261119 Replaced != with LENGTH/TRIM checks in Nova package SQL
    :: query so cmd delayed expansion does not strip negation
    :: and handled component= values without a slash safely
    :: v3p2 20261119 Wrote Nova package SQL query to a temp .sql file to avoid
    :: cmd parsing syntax errors and wrote PS_DIFF_3P line-by-line
    :: instead of using an outer parenthesized block
    :: v3p1 20261119 Insrumented the orphan section as it was throwing errors
    :: v3p0 20261119 Fixed command syntax error when generating the PowerShell
    :: diff script in check_missing_3p and wrapped the Nova
    :: package query in a subquery so package_name matches cleanly
    :: v2p9 20261119 Added a final sanity check before quitting to compare
    :: the list of packages that have icons on the homescreen
    :: against all the user-installed packages on the phone
    :: to create an orphan-packages file that have no icons
    :: v2p8 20261119 Added quit option at folder selection prompt and loop back
    :: prompt at end to export another folder or pane
    :: v2p7 20261119 Replaced fragile DISTINCT screen loop with explicit pane
    :: index pass 0 to 9 using CAST screen AS INTEGER so panes
    :: with folders or loose apps always appear in order
    :: v2p6 20261119 Fixed pane screen query so folders on pane 0, pane 1 and
    :: pane 2 display properly along with loose pane apps and other
    :: v2p5 20261119 Grouped folders by screen number across panes and kept
    :: unmatched folders under other at the bottom
    :: v2p4 20261119 Added loose apps choice at the end of each pane with
    :: non-folder items and kept other catch-all at the bottom
    :: v2p3 20261119 Listed folders under dock and each pane with no default
    :: and skipped empty sections
    :: v2p2 20261119 Added full-layout option outputting dock and pane headers
    :: with package_name and app_title lines
    :: v2p1 20261119 Replaced backtick for /f calls on DOCK_TOTAL and PANE_TOTAL
    :: with temp file redirects so cmd reliably captures counts
    :: v2p0 20261119 Removed ampersand and parenthesis inside comment labels
    :: as labels are not comments even though they act like them
    :: v1p9 20261119 Removed item_type column from output and grouped folders
    :: by their homescreen pane eg, "Pane 0 Folder: weather"
    :: v1p8 20261119 Dynamically lists dock, eg, container = -101, and lists
    :: homescreen panes by screen number, eg, container = -100,
    :: and by named folders eg, itemType = 2, from nova db
    :: and includes item_type in output
    :: v1p7 20261119 Searches android storage for novabackup files when none
    :: are found in ANDROID_BCK_DIR, storing full remote paths so
    :: backups in any folder can be pulled cleanly
    :: v1p6 20261119 Set DEBUG=0 by default for clean normal output while keeping
    :: the toggle available for troubleshooting
    :: v1p5 20261119 Reversed output columns to package_name first, app_title
    :: second and added startup dependency check for adb and
    :: sqlite3 dependency checking configured paths and PATH
    :: v1p4 20261119 Moved powershell commands into %TEMP%\* ps1 scripts run via
    :: "-File" instead of backticks so cmd never parses "<" or ">"
    :: v1p3 20261119 Added DEBUG=1 instrumentation
    :: v1p2 20261119 Replaced cmd FOR sanitizer with powershell
    :: v1p1 20261119 Numbered selection menu for novabackup files, lists folders
    :: by name with numbered selection instead of raw container IDs
    :: v1p0 20261119 Initial version to pull backup or use local nova db, query
    :: sql via sqlite3 exe, select columns with powershell
    :: -------------------------------------------------------------------------
    @echo off
    setlocal enabledelayedexpansion
    cd /d "%~dp0"

    :: --- Debug flag 1 = verbose DEBUG traces, 0 = quiet ---
    set "DEBUG=0"
    :: set "DEBUG=1"

    :: --- Configurable paths ---
    set "ADB_EXE=C:\app\editor\android\scrcpy\adb.exe"
    set "SQLITE_EXE=C:\app\editor\android\sdk\platform-tools\sqlite3.exe"
    set "WORK_DIR=C:\app\editor\android\scrcpy\nova"
    set "ANDROID_BCK_DIR=/storage/emulated/0/0000/bck/nova_backup"
    set "DEFAULT_CONTAINER=2921"

    if "%DEBUG%"=="1" (
    echo [DEBUG] SCRIPT_DIR="%~dp0"
    echo [DEBUG] CD="%CD%"
    echo [DEBUG] ADB_EXE="%ADB_EXE%"
    echo [DEBUG] SQLITE_EXE="%SQLITE_EXE%"
    echo [DEBUG] WORK_DIR="%WORK_DIR%"
    )

    :: -------------------------------------------------------------------------
    :: Startup dependency and PATH check for adb exe and sqlite3 exe
    :: -------------------------------------------------------------------------
    echo Checking required tools (adb and sqlite3) ...

    set "PATH_ADB="
    for /f "usebackq delims=" %%W in (`where adb 2^>nul`) do (
    if "!PATH_ADB!"=="" set "PATH_ADB=%%W"
    )

    set "PATH_SQLITE="
    for /f "usebackq delims=" %%W in (`where sqlite3 2^>nul`) do (
    if "!PATH_SQLITE!"=="" set "PATH_SQLITE=%%W"
    )

    if "%DEBUG%"=="1" (
    echo [DEBUG] PATH_ADB="!PATH_ADB!"
    echo [DEBUG] PATH_SQLITE="!PATH_SQLITE!"
    )

    :: Prefer configured path if it exists, otherwise fall back to PATH
    if not exist "%ADB_EXE%" (
    if not "!PATH_ADB!"=="" (
    echo [INFO] Configured ADB_EXE not found; using PATH: "!PATH_ADB!"
    set "ADB_EXE=!PATH_ADB!"
    ) else (
    echo [WARN] adb.exe not found at "%ADB_EXE%" and not in PATH.
    )
    ) else if "!PATH_ADB!"=="" (
    echo [INFO] adb.exe found at configured path, though not in PATH.
    )

    if not exist "%SQLITE_EXE%" (
    if not "!PATH_SQLITE!"=="" (
    echo [INFO] Configured SQLITE_EXE not found; using PATH: "!PATH_SQLITE!"
    set "SQLITE_EXE=!PATH_SQLITE!"
    ) else (
    echo [ERROR] sqlite3.exe not found at "%SQLITE_EXE%" and not in PATH.
    pause
    exit /b 1
    )
    ) else if "!PATH_SQLITE!"=="" (
    echo [INFO] sqlite3.exe found at configured path, though not in PATH.
    )

    if not exist "%WORK_DIR%" mkdir "%WORK_DIR%"

    echo Working directory: "%CD%"
    echo Nova work directory: "%WORK_DIR%"
    echo ----------------
    echo.
    echo Select source for Nova Launcher database:
    echo [1] Pull .novabackup from Android via ADB and extract nova.db [Default]
    echo [2] Use an existing nova.db or .novabackup or .zip already on Windows
    echo.
    set "SRC_CHOICE=1"
    set /p "SRC_CHOICE=Enter choice [1 or 2]: "
    if "%DEBUG%"=="1" echo [DEBUG] SRC_CHOICE="!SRC_CHOICE!"

    if "%SRC_CHOICE%"=="2" goto :use_local_source
    if "%SRC_CHOICE%"=="1" goto :pull_from_android
    goto :pull_from_android

    :: -------------------------------------------------------------------------
    :: Option 1: Pull backup from android via adb
    :: -------------------------------------------------------------------------
    :pull_from_android
    echo.
    echo --- Pull Nova Backup from Android ---

    if not exist "%ADB_EXE%" (
    echo [ERROR] adb.exe not found at: "%ADB_EXE%"
    pause
    exit /b 1
    )

    set "ADB_TARGET="
    for /f "skip=1 tokens=1" %%g in ('"%ADB_EXE%" devices') do (
    if not "%%g"=="" (
    if "!ADB_TARGET!"=="" set "ADB_TARGET=%%g"
    )
    )

    if "%DEBUG%"=="1" echo [DEBUG] ADB_TARGET="!ADB_TARGET!"

    if "!ADB_TARGET!"=="" (
    echo [ERROR] No connected ADB devices found.
    pause
    exit /b 1
    )

    :: beginning of changes in v5p5
    echo Targeting device: %ADB_TARGET%

    set "MAKE_BCK="
    set /p "MAKE_BCK=Open Nova Launcher settings on device to create a new backup first? [y/N]: "
    if /i "!MAKE_BCK!"=="y" (
    echo Launching Nova Launcher settings on %ADB_TARGET% ...
    echo "Tap Backup & restore > Backup > Save to save to your device"
    "%ADB_EXE%" -s %ADB_TARGET% shell am start -n com.teslacoilsw.launcher/com.teslacoilsw.launcher.preferences.SettingsActivity
    echo Create your backup in Nova Launcher on the device, then press ENTER to list backups.
    pause
    )

    echo Listing backups in %ANDROID_BCK_DIR% ...
    echo.

    "%ADB_EXE%" -s %ADB_TARGET% shell ls -1t "%ANDROID_BCK_DIR%"/*.novabackup 2>nul > "%TEMP%\nova_backups.txt"

    if "%DEBUG%"=="1" (
    echo [DEBUG] ls exit errorlevel=!errorlevel!
    echo [DEBUG] Raw %TEMP%\nova_backups.txt contents:
    type "%TEMP%\nova_backups.txt" 2>nul
    )

    set "BCK_COUNT=0"
    for /f "usebackq delims=" %%B in ("%TEMP%\nova_backups.txt") do (
    set "LINE=%%B"
    if not "!LINE!"=="" (
    set "LINE=!LINE:^M=!"
    for %%F in ("!LINE!") do set "FNAME=%%~nxF"
    set /a BCK_COUNT+=1
    set "BCK_ITEM_!BCK_COUNT!=!FNAME!"
    set "BCK_PATH_!BCK_COUNT!=!LINE!"
    echo [!BCK_COUNT!] !FNAME!
    if "%DEBUG%"=="1" (
    echo [DEBUG] BCK_ITEM_!BCK_COUNT!="!FNAME!"
    echo [DEBUG] BCK_PATH_!BCK_COUNT!="!LINE!"
    )
    )
    )
    del "%TEMP%\nova_backups.txt" >nul 2>&1

    if %BCK_COUNT% EQU 0 (
    echo [INFO] No .novabackup files found in %ANDROID_BCK_DIR%.
    echo Searching Android storage for *.novabackup files ...
    echo.

    "%ADB_EXE%" -s %ADB_TARGET% shell "for d in /storage/emulated/0 /storage/*; do [ -d \"\$d\" ] && [ \"\$d\" != \"/storage/emulated\" ] && find \"\$d\" -maxdepth 5 -name '*.novabackup' 2>/dev/null; done" 2>nul > "%TEMP%\nova_backups_search.txt"

    if "%DEBUG%"=="1" (
    echo [DEBUG] Search exit errorlevel=!errorlevel!
    echo [DEBUG] Raw %TEMP%\nova_backups_search.txt contents:
    type "%TEMP%\nova_backups_search.txt" 2>nul
    )

    for /f "usebackq delims=" %%S in ("%TEMP%\nova_backups_search.txt") do (
    set "LINE=%%S"
    if not "!LINE!"=="" (
    set "LINE=!LINE:^M=!"
    for %%F in ("!LINE!") do set "FNAME=%%~nxF"
    set /a BCK_COUNT+=1
    set "BCK_ITEM_!BCK_COUNT!=!FNAME!"
    set "BCK_PATH_!BCK_COUNT!=!LINE!"
    echo [!BCK_COUNT!] !LINE!
    if "%DEBUG%"=="1" (
    echo [DEBUG] BCK_ITEM_!BCK_COUNT!="!FNAME!"
    echo [DEBUG] BCK_PATH_!BCK_COUNT!="!LINE!"
    )
    )
    )
    del "%TEMP%\nova_backups_search.txt" >nul 2>&1
    )

    if %BCK_COUNT% EQU 0 (
    echo [WARN] No .novabackup files found in %ANDROID_BCK_DIR% or Android storage.
    :manual_bck
    set "BCK_FILE="
    set /p "BCK_FILE=Enter backup filename or full Android path e.g. 2026-11-19_12-57.novabackup: "
    if "!BCK_FILE!"=="" (
    echo [ERROR] No backup filename provided.
    pause
    exit /b 1
    )
    set "BCK_FILE=!BCK_FILE:"=!"
    set "REMOTE_BCK=!BCK_FILE!"
    if not "!REMOTE_BCK:~0,1!"=="/" set "REMOTE_BCK=%ANDROID_BCK_DIR%/!BCK_FILE!"
    for %%F in ("!REMOTE_BCK!") do set "BCK_FILE=%%~nxF"
    goto :pull_selected_backup
    )

    echo.
    set "BCK_PICK=1"
    set /p "BCK_PICK=Select backup number [1-%BCK_COUNT%, Default: 1]: "
    if "!BCK_PICK!"=="" set "BCK_PICK=1"
    if "%DEBUG%"=="1" echo [DEBUG] BCK_PICK="!BCK_PICK!"

    set "BCK_FILE="
    set "REMOTE_BCK="
    for /l %%N in (1,1,%BCK_COUNT%) do (
    if "!BCK_PICK!"=="%%N" (
    set "BCK_FILE=!BCK_ITEM_%%N!"
    set "REMOTE_BCK=!BCK_PATH_%%N!"
    )
    )

    if "!BCK_FILE!"=="" (
    set "CANDIDATE=!BCK_PICK:"=!"
    set "REMOTE_BCK=!CANDIDATE!"
    if not "!REMOTE_BCK:~0,1!"=="/" set "REMOTE_BCK=%ANDROID_BCK_DIR%/!CANDIDATE!"
    for %%F in ("!REMOTE_BCK!") do set "BCK_FILE=%%~nxF"
    )
    if "%DEBUG%"=="1" (
    echo [DEBUG] BCK_FILE="!BCK_FILE!"
    echo [DEBUG] REMOTE_BCK="!REMOTE_BCK!"
    )

    :pull_selected_backup
    set "LOCAL_BCK=%WORK_DIR%\%BCK_FILE%"
    set "LOCAL_ZIP=%WORK_DIR%\backup.zip"
    set "EXTRACT_DIR=%WORK_DIR%\backup_extracted"

    echo.
    echo Pulling "%REMOTE_BCK%" to "%LOCAL_BCK%" ...
    "%ADB_EXE%" -s %ADB_TARGET% pull "%REMOTE_BCK%" "%LOCAL_BCK%"
    if errorlevel 1 (
    echo [ERROR] Failed to pull backup from Android.
    pause
    exit /b 1
    )

    if exist "%LOCAL_ZIP%" del /f /q "%LOCAL_ZIP%"
    ren "%LOCAL_BCK%" "backup.zip"
    if errorlevel 1 (
    echo [ERROR] Failed to rename "%LOCAL_BCK%" to backup.zip.
    pause
    exit /b 1
    )

    if exist "%EXTRACT_DIR%" rmdir /s /q "%EXTRACT_DIR%"
    echo Extracting backup.zip to "%EXTRACT_DIR%" ...
    powershell -NoProfile -Command "Expand-Archive -LiteralPath '%LOCAL_ZIP%' -DestinationPath '%EXTRACT_DIR%' -Force"
    if errorlevel 1 (
    echo [ERROR] Failed to extract backup.zip.
    pause
    exit /b 1
    )

    set "DB_PATH=%EXTRACT_DIR%\nova.db"

    goto :verify_db

    :: -------------------------------------------------------------------------
    :: Option 2: Use local nova db or novabackup or zip
    :: -------------------------------------------------------------------------
    :use_local_source
    echo.
    echo --- Local Database Selection ---
    echo Enter the path to nova.db or a .novabackup or .zip file.
    echo Default: "%WORK_DIR%\backup_extracted\nova.db"
    echo.

    :ask_local_db
    set "USER_DB="
    set /p "USER_DB=Path to database or backup file [Enter for default]: "

    if "!USER_DB!"=="" (
    set "DB_PATH=%WORK_DIR%\backup_extracted\nova.db"
    ) else (
    set "USER_DB=!USER_DB:"=!"
    for %%A in ("!USER_DB!") do set "DB_PATH=%%~fA"
    )

    if not exist "%DB_PATH%" (
    echo [ERROR] File not found: "%DB_PATH%"
    set "RETRY="
    set /p "RETRY=Try again? [Y/n]: "
    if /i "!RETRY!"=="n" exit /b 1
    goto :ask_local_db
    )

    for %%E in ("%DB_PATH%") do set "EXT=%%~xE"
    if /i "!EXT!"==".novabackup" goto :local_novabackup
    if /i "!EXT!"==".zip" goto :extract_local_archive
    goto :verify_db

    :local_novabackup
    echo.
    set "RESTORE_LOCAL="
    set /p "RESTORE_LOCAL=Restore this backup in Nova on the connected device? [y/N]: "
    if /i not "!RESTORE_LOCAL!"=="y" goto :extract_local_archive

    if not exist "%ADB_EXE%" (
    echo [ERROR] adb.exe not found at "%ADB_EXE%"; cannot send the backup to the device.
    pause
    exit /b 1
    )

    set "RESTORE_TARGET="
    for /f "skip=1 tokens=1" %%g in ('"%ADB_EXE%" devices') do (
    if not "%%g"=="" (
    if "!RESTORE_TARGET!"=="" set "RESTORE_TARGET=%%g"
    )
    )

    if "!RESTORE_TARGET!"=="" (
    echo [ERROR] No connected ADB device found; cannot restore the backup.
    pause
    exit /b 1
    )

    set "NOVA_BACKUP_DIR=/storage/emulated/0/Android/data/com.teslacoilsw.launcher/files/Backup"
    echo Copying "%DB_PATH%" to Nova's backup folder on !RESTORE_TARGET! ...
    "%ADB_EXE%" -s !RESTORE_TARGET! shell mkdir -p "%NOVA_BACKUP_DIR%"
    if errorlevel 1 (
    echo [ERROR] Could not create Nova's backup folder on the device.
    pause
    exit /b 1
    )

    "%ADB_EXE%" -s !RESTORE_TARGET! push "%DB_PATH%" "%NOVA_BACKUP_DIR%/"
    if errorlevel 1 (
    echo [ERROR] Failed to copy the backup to the device.
    pause
    exit /b 1
    )

    echo Launching Nova Launcher settings on !RESTORE_TARGET! ...
    "%ADB_EXE%" -s !RESTORE_TARGET! shell am start -n com.teslacoilsw.launcher/com.teslacoilsw.launcher.preferences.SettingsActivity
    echo In Nova, choose Backup & restore and restore the backup you copied.
    goto :extract_local_archive

    :extract_local_archive
    set "EXTRACT_DIR=%WORK_DIR%\backup_extracted"
    if exist "%EXTRACT_DIR%" rmdir /s /q "%EXTRACT_DIR%"
    echo Extracting "%DB_PATH%" to "%EXTRACT_DIR%" ...
    powershell -NoProfile -Command "Expand-Archive -LiteralPath '%DB_PATH%' -DestinationPath '%EXTRACT_DIR%' -Force"
    if errorlevel 1 (
    echo [ERROR] Failed to extract archive.
    pause
    exit /b 1
    )
    set "DB_PATH=%EXTRACT_DIR%\nova.db"

    :: -------------------------------------------------------------------------
    :: Verify database and list dock, panes, folders and other
    :: -------------------------------------------------------------------------
    :verify_db
    if not exist "%DB_PATH%" (
    echo [ERROR] nova.db not found at: "%DB_PATH%"
    pause
    exit /b 1
    )

    echo.
    echo Using database: "%DB_PATH%"
    echo Scanning Nova Launcher dock, panes and folders ...
    echo.

    set "TGT_COUNT=0"
    set "LISTED_FOLDER_IDS=,"

    :: 1 Dock section first as [1] dock apps plus dock folders if any
    echo dock
    set /a TGT_COUNT+=1
    set "TGT_LABEL_!TGT_COUNT!=dock apps"
    set "TGT_WHERE_!TGT_COUNT!=f.container = -101"
    set "TGT_ORDER_!TGT_COUNT!=f.screen, f.cellY, f.cellX, f.rank, f._id"
    echo [!TGT_COUNT!] dock apps

    "%SQLITE_EXE%" -cmd ".separator |" "%DB_PATH%" "SELECT _id, CASE WHEN title IS NULL OR TRIM(title) = '' THEN '(Untitled Folder)' ELSE title END FROM favorites WHERE itemType = 2 AND container = -101 ORDER BY cellY, cellX, rank, _id;" > "%TEMP%\nova_dock_folders.txt" 2>nul
    for /f "usebackq tokens=1* delims=|" %%A in ("%TEMP%\nova_dock_folders.txt") do (
    set "FID=%%A"
    set "FNAME=%%B"
    set "FNAME=!FNAME:^M=!"
    if not "!FID!"=="" (
    set /a TGT_COUNT+=1
    set "TGT_LABEL_!TGT_COUNT!=dock - !FNAME!"
    set "TGT_WHERE_!TGT_COUNT!=f.container = !FID!"
    set "TGT_ORDER_!TGT_COUNT!=f.rank, f._id"
    set "LISTED_FOLDER_IDS=!LISTED_FOLDER_IDS!!FID!,"
    echo [!TGT_COUNT!] !FNAME!
    )
    )
    del "%TEMP%\nova_dock_folders.txt" >nul 2>&1

    :: 2 Panes 0 to 14 with folders and loose apps via :scan_pane subroutine
    for /l %%P in (0,1,14) do (
    call :scan_pane %%P
    )

    :: 3 Other folders not already listed under dock or a pane
    "%SQLITE_EXE%" -cmd ".separator |" "%DB_PATH%" "SELECT _id, CASE WHEN title IS NULL OR TRIM(title) = '' THEN '(Untitled Folder)' ELSE title END FROM favorites WHERE itemType = 2 ORDER BY LOWER(title), _id;" > "%TEMP%\nova_other_folders.txt" 2>nul
    set "OTHER_HAS_FOLDERS=0"
    for /f "usebackq tokens=1* delims=|" %%A in ("%TEMP%\nova_other_folders.txt") do (
    set "FID=%%A"
    set "FNAME=%%B"
    set "FNAME=!FNAME:^M=!"
    if not "!FID!"=="" (
    echo !LISTED_FOLDER_IDS! | findstr /c:",!FID!," >nul
    if errorlevel 1 (
    if "!OTHER_HAS_FOLDERS!"=="0" (
    echo other
    set "OTHER_HAS_FOLDERS=1"
    )
    set /a TGT_COUNT+=1
    set "TGT_LABEL_!TGT_COUNT!=other - !FNAME!"
    set "TGT_WHERE_!TGT_COUNT!=f.container = !FID!"
    set "TGT_ORDER_!TGT_COUNT!=f.rank, f._id"
    echo [!TGT_COUNT!] !FNAME!
    )
    )
    )
    del "%TEMP%\nova_other_folders.txt" >nul 2>&1

    echo.
    set "TGT_PICK="
    :: Allow q or 0 to quit cleanly without running a query
    set /p "TGT_PICK=Select number [1-%TGT_COUNT%, q to quit]: "
    if "%DEBUG%"=="1" echo [DEBUG] TGT_PICK="!TGT_PICK!"

    if /i "!TGT_PICK!"=="q" goto :check_missing_3p
    if "!TGT_PICK!"=="0" goto :check_missing_3p

    set "SELECTED_LABEL="
    set "SQL_WHERE="
    set "SQL_ORDER="
    for /l %%N in (1,1,%TGT_COUNT%) do (
    if "!TGT_PICK!"=="%%N" (
    set "SELECTED_LABEL=!TGT_LABEL_%%N!"
    set "SQL_WHERE=!TGT_WHERE_%%N!"
    set "SQL_ORDER=!TGT_ORDER_%%N!"
    )
    )

    if "%DEBUG%"=="1" (
    echo [DEBUG] SELECTED_LABEL="!SELECTED_LABEL!"
    echo [DEBUG] SQL_WHERE="!SQL_WHERE!"
    echo [DEBUG] SQL_ORDER="!SQL_ORDER!"
    )

    if "!SQL_WHERE!"=="" (
    echo [ERROR] Invalid selection: "!TGT_PICK!"
    pause
    exit /b 1
    )

    :run_query
    if "%DEBUG%"=="1" echo [DEBUG] Entering :run_query

    :: Write label character replacer ps1 to %TEMP% so cmd never parses regex characters
    set "PS_SANITIZE=%TEMP%\adbfolder_sanitize.ps1"
    set "SAFE_NAME_FILE=%TEMP%\adbfolder_safename.txt"

    "%PS_SANITIZE%" echo $raw = $env:SELECTED_LABEL
    "%PS_SANITIZE%" echo $s = [regex]::Replace($raw, '[\\/:*?"<>|() ]+', '_')
    "%PS_SANITIZE%" echo $s = $s.Trim('_')
    "%PS_SANITIZE%" echo if ([string]::IsNullOrWhiteSpace($s)) { $s = "nova_target" }
    "%PS_SANITIZE%" echo [System.IO.File]::WriteAllText($env:SAFE_NAME_FILE, $s, (New-Object System.Text.UTF8Encoding($false)))

    if "%DEBUG%"=="1" (
    echo [DEBUG] Wrote "%PS_SANITIZE%"
    echo [DEBUG] Running character replacer PowerShell script...
    )

    powershell -NoProfile -ExecutionPolicy Bypass -File "%PS_SANITIZE%"
    if "%DEBUG%"=="1" echo [DEBUG] Character replacer exit errorlevel=!errorlevel!

    set "SAFE_NAME="
    if exist "%SAFE_NAME_FILE%" (
    for /f "usebackq delims=" %%S in ("%SAFE_NAME_FILE%") do set "SAFE_NAME=%%S"
    )
    if "!SAFE_NAME!"=="" set "SAFE_NAME=nova_target"

    del "%PS_SANITIZE%" >nul 2>&1
    del "%SAFE_NAME_FILE%" >nul 2>&1

    if "%DEBUG%"=="1" echo [DEBUG] SAFE_NAME="!SAFE_NAME!"

    set "RAW_OUT=%WORK_DIR%\output.txt"
    set "CLEAN_OUT=%WORK_DIR%\%SAFE_NAME%_apps.txt"
    set "LOG_OUT=%WORK_DIR%\adbfolder_log.txt"
    set "SQL_QUERY_FILE=%TEMP%\adbfolder_query.sql"

    if "%DEBUG%"=="1" (
    echo [DEBUG] RAW_OUT="%RAW_OUT%"
    echo [DEBUG] CLEAN_OUT="%CLEAN_OUT%"
    echo [DEBUG] SQL_QUERY_FILE="%SQL_QUERY_FILE%"
    )

    echo.
    echo Querying "!SELECTED_LABEL!" ...

    "%SQL_QUERY_FILE%" echo .header on
    "%SQL_QUERY_FILE%" echo .mode tabs
    "%SQL_QUERY_FILE%" echo SELECT f._id AS item_id,
    "%SQL_QUERY_FILE%" echo f.title AS display_name,
    "%SQL_QUERY_FILE%" echo CASE
    "%SQL_QUERY_FILE%" echo WHEN f.iconPackage IS NOT NULL AND LENGTH(TRIM(f.iconPackage^)^) ^> 0 THEN TRIM(f.iconPackage^)
    "%SQL_QUERY_FILE%" echo WHEN INSTR(f.intent, 'component='^) ^> 0 THEN
    "%SQL_QUERY_FILE%" echo CASE
    "%SQL_QUERY_FILE%" echo WHEN INSTR(SUBSTR(f.intent, INSTR(f.intent, 'component='^) + 10^), '/'^) ^> 0 THEN SUBSTR(SUBSTR(f.intent, INSTR(f.intent, 'component='^) + 10^), 1, INSTR(SUBSTR(f.intent, INSTR(f.intent, 'component='^) + 10^), '/'^) - 1^)
    "%SQL_QUERY_FILE%" echo WHEN INSTR(SUBSTR(f.intent, INSTR(f.intent, 'component='^) + 10^), ';'^) ^> 0 THEN SUBSTR(SUBSTR(f.intent, INSTR(f.intent, 'component='^) + 10^), 1, INSTR(SUBSTR(f.intent, INSTR(f.intent, 'component='^) + 10^), ';'^) - 1^)
    "%SQL_QUERY_FILE%" echo ELSE SUBSTR(f.intent, INSTR(f.intent, 'component='^) + 10^)
    "%SQL_QUERY_FILE%" echo END
    "%SQL_QUERY_FILE%" echo WHEN INSTR(f.intent, 'package='^) ^> 0 THEN
    "%SQL_QUERY_FILE%" echo CASE
    "%SQL_QUERY_FILE%" echo WHEN INSTR(SUBSTR(f.intent, INSTR(f.intent, 'package='^) + 8^), ';'^) ^> 0 THEN SUBSTR(SUBSTR(f.intent, INSTR(f.intent, 'package='^) + 8^), 1, INSTR(SUBSTR(f.intent, INSTR(f.intent, 'package='^) + 8^), ';'^) - 1^)
    "%SQL_QUERY_FILE%" echo ELSE SUBSTR(f.intent, INSTR(f.intent, 'package='^) + 8^)
    "%SQL_QUERY_FILE%" echo END
    "%SQL_QUERY_FILE%" echo ELSE ''
    "%SQL_QUERY_FILE%" echo END AS package_name,
    "%SQL_QUERY_FILE%" echo f.intent
    "%SQL_QUERY_FILE%" echo FROM favorites f
    "%SQL_QUERY_FILE%" echo WHERE !SQL_WHERE!
    "%SQL_QUERY_FILE%" echo ORDER BY !SQL_ORDER!;

    "%SQLITE_EXE%" "%DB_PATH%" < "%SQL_QUERY_FILE%" > "%RAW_OUT%"

    if "%DEBUG%"=="1" (
    echo [DEBUG] sqlite3 query exit errorlevel=!errorlevel!
    echo [DEBUG] Raw %RAW_OUT% line count:
    find /c /v "" "%RAW_OUT%" 2>nul
    )

    del "%SQL_QUERY_FILE%" >nul 2>&1

    if errorlevel 1 (
    echo [ERROR] SQLite query failed.
    pause
    exit /b 1
    )

    :: Write column formatter ps1 to %TEMP%
    :: Add pane/folder heading, indent spaces and append to log
    set "PS_FORMAT=%TEMP%\adbfolder_format.ps1"

    if exist "%PS_FORMAT%" del /f /q "%PS_FORMAT%" >nul 2>&1

    "%PS_FORMAT%" echo $rawFile = $env:RAW_OUT
    "%PS_FORMAT%" echo $cleanFile = $env:CLEAN_OUT
    "%PS_FORMAT%" echo $logFile = $env:LOG_OUT
    "%PS_FORMAT%" echo $label = $env:SELECTED_LABEL
    "%PS_FORMAT%" echo $rows = Import-Csv -LiteralPath $rawFile -Delimiter "`t"
    "%PS_FORMAT%" echo $lines = $rows ^| Select-Object package_name, display_name ^| Format-Table -AutoSize ^| Out-String -Width 4096
    "%PS_FORMAT%" echo $tableLines = @($lines -split "`r?`n" ^| ForEach-Object { $_.TrimEnd() } ^| Where-Object { $_ -ne '' })
    "%PS_FORMAT%" echo $header = " $label"
    "%PS_FORMAT%" echo if ($label -match '^pane\s+(\d+)\s+-\s+(.+)$') { $header = (' pane {0} folder "{1}"' -f $Matches[1], $Matches[2]) }
    "%PS_FORMAT%" echo $body = ($tableLines ^| ForEach-Object { ' ' + $_ }) -join "`r`n"
    "%PS_FORMAT%" echo $clean = $header + "`r`n" + $body + "`r`n"
    "%PS_FORMAT%" echo $utf8 = New-Object System.Text.UTF8Encoding($false)
    "%PS_FORMAT%" echo [System.IO.File]::WriteAllText($cleanFile, $clean, $utf8)
    "%PS_FORMAT%" echo $timestamp = Get-Date -Format 'yyyy-MM-dd HH:mm:ss'
    "%PS_FORMAT%" echo $entry = "`r`n============================================================`r`nExport: $timestamp`r`n$clean"
    "%PS_FORMAT%" echo [System.IO.File]::AppendAllText($logFile, $entry, $utf8)

    if "%DEBUG%"=="1" echo [DEBUG] Running formatter PowerShell script "%PS_FORMAT%"...
    powershell -NoProfile -ExecutionPolicy Bypass -File "%PS_FORMAT%"
    if "%DEBUG%"=="1" echo [DEBUG] PowerShell formatter exit errorlevel=!errorlevel!

    del "%PS_FORMAT%" >nul 2>&1

    if errorlevel 1 (
    echo [ERROR] Failed to format output columns or append running log.
    pause
    exit /b 1
    )

    echo.
    echo --- Result (%CLEAN_OUT%) ---
    echo.
    type "%CLEAN_OUT%"
    echo.
    echo Raw tab-delimited output saved to: "%RAW_OUT%"
    echo Formatted app list saved to: "%CLEAN_OUT%"
    echo Running export log saved to: "%LOG_OUT%"
    echo.

    :: Loop back to menu so user can export another folder or pane
    set "LOOP_MORE="
    set /p "LOOP_MORE=Export another folder or pane? [y/N]: "
    if /i "!LOOP_MORE!"=="y" goto :verify_db

    :: -------------------------------------------------------------------------
    :: End-of-run check for third-party packages -3 missing from nova.db
    :: -------------------------------------------------------------------------
    :check_missing_3p
    echo.
    set "CHECK_3P="
    set /p "CHECK_3P=Check user apps -3 with no icon in Nova before quitting? [y/N]: "
    if /i not "!CHECK_3P!"=="y" goto :quit_script

    if "%DEBUG%"=="1" (
    echo [DEBUG] Entering :check_missing_3p
    echo [DEBUG] ADB_EXE="%ADB_EXE%"
    echo [DEBUG] SQLITE_EXE="%SQLITE_EXE%"
    echo [DEBUG] DB_PATH="%DB_PATH%"
    echo [DEBUG] ADB_TARGET="%ADB_TARGET%"
    )

    if not exist "%ADB_EXE%" (
    echo [INFO] adb.exe not found at "%ADB_EXE%"; skipping device package check.
    goto :quit_script
    )

    set "RUN_ADB_TARGET=%ADB_TARGET%"
    if "!RUN_ADB_TARGET!"=="" (
    for /f "skip=1 tokens=1" %%g in ('"%ADB_EXE%" devices') do (
    if not "%%g"=="" (
    if "!RUN_ADB_TARGET!"=="" set "RUN_ADB_TARGET=%%g"
    )
    )
    )

    if "%DEBUG%"=="1" echo [DEBUG] RUN_ADB_TARGET="!RUN_ADB_TARGET!"

    if "!RUN_ADB_TARGET!"=="" (
    echo [INFO] No connected ADB device found; skipping device package check.
    goto :quit_script
    )

    if not exist "%DB_PATH%" (
    echo [INFO] Nova database not available at "%DB_PATH%"; skipping device package check.
    goto :quit_script
    )

    set "RESOLVE_LABELS="
    set /p "RESOLVE_LABELS=Resolve app titles via adb/aapt slower over Wi-Fi? [y/N]: "
    set "DO_RESOLVE_LABELS=0"
    if /i "!RESOLVE_LABELS!"=="y" set "DO_RESOLVE_LABELS=1"
    if "%DEBUG%"=="1" echo [DEBUG] DO_RESOLVE_LABELS="!DO_RESOLVE_LABELS!"

    set "PM_3P_FILE=%TEMP%\adbfolder_pm3.txt"
    set "NOVA_PKGS_FILE=%TEMP%\adbfolder_nova_pkgs.txt"
    set "UNPLACED_OUT=%WORK_DIR%\unplaced_user_apps.txt"
    set "PS_DIFF_3P=%TEMP%\adbfolder_diff_3p.ps1"
    :: v3p2: Write SQL to a temp .sql file so cmd does not parse SQL operators/quotes
    set "SQL_NOVA_PKGS=%TEMP%\adbfolder_nova_pkgs.sql"

    if "%DEBUG%"=="1" (
    echo [DEBUG] PM_3P_FILE="!PM_3P_FILE!"
    echo [DEBUG] NOVA_PKGS_FILE="!NOVA_PKGS_FILE!"
    echo [DEBUG] UNPLACED_OUT="!UNPLACED_OUT!"
    echo [DEBUG] PS_DIFF_3P="!PS_DIFF_3P!"
    echo [DEBUG] SQL_NOVA_PKGS="!SQL_NOVA_PKGS!"
    )

    echo Querying third-party packages from device !RUN_ADB_TARGET! ...
    if "%DEBUG%"=="1" echo [DEBUG] Running adb pm list packages -3...
    "%ADB_EXE%" -s !RUN_ADB_TARGET! shell pm list packages -3 2>nul > "!PM_3P_FILE!"
    if "%DEBUG%"=="1" (
    echo [DEBUG] adb pm exit errorlevel=!errorlevel!
    echo [DEBUG] PM_3P_FILE line count:
    find /c /v "" "!PM_3P_FILE!" 2>nul
    )

    echo Querying packages referenced anywhere in nova.db ...
    if "%DEBUG%"=="1" echo [DEBUG] Writing and running sqlite3 Nova package query from .sql file...
    :: v3p3: Use LENGTH/TRIM checks instead of != so delayed expansion cannot drop negation
    "!SQL_NOVA_PKGS!" echo SELECT DISTINCT package_name
    "!SQL_NOVA_PKGS!" echo FROM (
    "!SQL_NOVA_PKGS!" echo SELECT CASE
    "!SQL_NOVA_PKGS!" echo WHEN iconPackage IS NOT NULL AND LENGTH(TRIM(iconPackage^)^) ^> 0 THEN TRIM(iconPackage^)
    "!SQL_NOVA_PKGS!" echo WHEN INSTR(intent, 'component='^) ^> 0 THEN
    "!SQL_NOVA_PKGS!" echo CASE
    "!SQL_NOVA_PKGS!" echo WHEN INSTR(SUBSTR(intent, INSTR(intent, 'component='^) + 10^), '/'^) ^> 0 THEN SUBSTR(
    "!SQL_NOVA_PKGS!" echo SUBSTR(intent, INSTR(intent, 'component='^) + 10^),
    "!SQL_NOVA_PKGS!" echo 1,
    "!SQL_NOVA_PKGS!" echo INSTR(SUBSTR(intent, INSTR(intent, 'component='^) + 10^), '/'^) - 1
    "!SQL_NOVA_PKGS!" echo ^)
    "!SQL_NOVA_PKGS!" echo ELSE SUBSTR(intent, INSTR(intent, 'component='^) + 10^)
    "!SQL_NOVA_PKGS!" echo END
    "!SQL_NOVA_PKGS!" echo ELSE ''
    "!SQL_NOVA_PKGS!" echo END AS package_name
    "!SQL_NOVA_PKGS!" echo FROM favorites
    "!SQL_NOVA_PKGS!" echo )
    "!SQL_NOVA_PKGS!" echo WHERE LENGTH(package_name^) ^> 0;

    "%SQLITE_EXE%" "%DB_PATH%" < "!SQL_NOVA_PKGS!" > "!NOVA_PKGS_FILE!"
    if "%DEBUG%"=="1" (
    echo [DEBUG] sqlite3 Nova pkgs exit errorlevel=!errorlevel!
    echo [DEBUG] NOVA_PKGS_FILE line count:
    find /c /v "" "!NOVA_PKGS_FILE!" 2>nul
    echo [DEBUG] Writing PS_DIFF_3P script...
    )

    :: v3p2: Write PS_DIFF_3P line-by-line instead of an outer parenthesized block
    :: v3p4: Resolve app labels for unplaced packages via adb dumpsys and aapt/aapt2 if available
    :: v3p5: Remove stray caret escaping before closing paren on standalone echo lines
    :: v3p6: Prompt whether to resolve app titles and print periodic progress during lookup
    if exist "!PS_DIFF_3P!" del /f /q "!PS_DIFF_3P!" >nul 2>&1
    "!PS_DIFF_3P!" echo $adbExe = $env:ADB_EXE
    "!PS_DIFF_3P!" echo $adbTarget = $env:RUN_ADB_TARGET
    "!PS_DIFF_3P!" echo $resolveLabels = ($env:DO_RESOLVE_LABELS -eq '1')
    "!PS_DIFF_3P!" echo $pm3Lines = Get-Content -LiteralPath $env:PM_3P_FILE -ErrorAction SilentlyContinue
    "!PS_DIFF_3P!" echo $installed3 = [System.Collections.Generic.HashSet[string]]::new([System.StringComparer]::OrdinalIgnoreCase)
    "!PS_DIFF_3P!" echo foreach ($line in $pm3Lines) {
    "!PS_DIFF_3P!" echo $p = ($line -replace '\r', '').Trim()
    "!PS_DIFF_3P!" echo if ($p.StartsWith('package:')) { $p = $p.Substring(8).Trim() }
    "!PS_DIFF_3P!" echo if (-not [string]::IsNullOrWhiteSpace($p)) { [void]$installed3.Add($p) }
    "!PS_DIFF_3P!" echo }
    "!PS_DIFF_3P!" echo $novaLines = Get-Content -LiteralPath $env:NOVA_PKGS_FILE -ErrorAction SilentlyContinue
    "!PS_DIFF_3P!" echo $inNova = [System.Collections.Generic.HashSet[string]]::new([System.StringComparer]::OrdinalIgnoreCase)
    "!PS_DIFF_3P!" echo foreach ($n in $novaLines) {
    "!PS_DIFF_3P!" echo $pkg = ($n -replace '\r', '').Trim()
    "!PS_DIFF_3P!" echo if (-not [string]::IsNullOrWhiteSpace($pkg)) { [void]$inNova.Add($pkg) }
    "!PS_DIFF_3P!" echo }
    "!PS_DIFF_3P!" echo $missingList = [System.Collections.Generic.List[string]]::new()
    "!PS_DIFF_3P!" echo foreach ($pkg in $installed3) {
    "!PS_DIFF_3P!" echo if (-not $inNova.Contains($pkg)) { [void]$missingList.Add($pkg) }
    "!PS_DIFF_3P!" echo }
    "!PS_DIFF_3P!" echo $missing = @($missingList.ToArray())
    "!PS_DIFF_3P!" echo [System.Array]::Sort($missing, [System.StringComparer]::OrdinalIgnoreCase)
    "!PS_DIFF_3P!" echo $aaptCmd = if ($resolveLabels) { Get-Command aapt -ErrorAction SilentlyContinue } else { $null }
    "!PS_DIFF_3P!" echo $idx = 0
    "!PS_DIFF_3P!" echo $results = foreach ($pkg in $missing) {
    "!PS_DIFF_3P!" echo $idx++
    "!PS_DIFF_3P!" echo $label = ''
    "!PS_DIFF_3P!" echo if ($resolveLabels) {
    "!PS_DIFF_3P!" echo if (($idx %% 10) -eq 1 -or $idx -eq $missing.Count) {
    "!PS_DIFF_3P!" echo Write-Host ("Resolving titles: {0}/{1} ({2})..." -f $idx, $missing.Count, $pkg)
    "!PS_DIFF_3P!" echo }
    "!PS_DIFF_3P!" echo $dumpLines = ^& $adbExe -s $adbTarget shell dumpsys package $pkg 2^>$null
    "!PS_DIFF_3P!" echo foreach ($dl in $dumpLines) {
    "!PS_DIFF_3P!" echo if ($dl -match 'nonLocalizedLabel="([^"]+)"') { $label = $Matches[1].Trim() }
    "!PS_DIFF_3P!" echo }
    "!PS_DIFF_3P!" echo if ([string]::IsNullOrWhiteSpace($label) -and $aaptCmd) {
    "!PS_DIFF_3P!" echo $apkPathLine = (^& $adbExe -s $adbTarget shell pm path $pkg 2^>$null ^| Select-Object -First 1)
    "!PS_DIFF_3P!" echo if ($apkPathLine -and $apkPathLine.Trim().StartsWith('package:')) {
    "!PS_DIFF_3P!" echo $apkRemote = $apkPathLine.Trim().Substring(8).Trim()
    "!PS_DIFF_3P!" echo $apkLocal = Join-Path $env:TEMP "adbfolder_probe.apk"
    "!PS_DIFF_3P!" echo ^& $adbExe -s $adbTarget pull $apkRemote $apkLocal ^>$null 2^>^&1
    "!PS_DIFF_3P!" echo if (Test-Path -LiteralPath $apkLocal) {
    "!PS_DIFF_3P!" echo $badging = ^& $aaptCmd.Source dump badging $apkLocal 2^>$null
    "!PS_DIFF_3P!" echo foreach ($bl in $badging) {
    "!PS_DIFF_3P!" echo if ($bl -match "^application-label:'([^']+)'") { $label = $Matches[1].Trim(); break }
    "!PS_DIFF_3P!" echo }
    "!PS_DIFF_3P!" echo Remove-Item -LiteralPath $apkLocal -Force -ErrorAction SilentlyContinue
    "!PS_DIFF_3P!" echo }
    "!PS_DIFF_3P!" echo }
    "!PS_DIFF_3P!" echo }
    "!PS_DIFF_3P!" echo }
    "!PS_DIFF_3P!" echo [PSCustomObject]@{ package_name = $pkg; app_title = $label }
    "!PS_DIFF_3P!" echo }
    "!PS_DIFF_3P!" echo $tableText = if (@($results).Count -gt 0) {
    "!PS_DIFF_3P!" echo ((@($results) ^| Format-Table -AutoSize ^| Out-String -Width 4096) -split "`r?`n" ^| ForEach-Object { $_.TrimEnd() } ^| Where-Object { $_ -ne '' }) -join "`r`n" + "`r`n"
    "!PS_DIFF_3P!" echo } else { "" }
    "!PS_DIFF_3P!" echo [System.IO.File]::WriteAllText($env:UNPLACED_OUT, $tableText, (New-Object System.Text.UTF8Encoding($false)))
    "!PS_DIFF_3P!" echo Write-Host ("User packages (-3): {0} | In Nova layout: {1} | No icon in Nova: {2}" -f $installed3.Count, $inNova.Count, $missing.Count)
    "!PS_DIFF_3P!" echo if (@($results).Count -gt 0) { Write-Host ""; Write-Output $tableText.TrimEnd() }

    if "%DEBUG%"=="1" (
    echo [DEBUG] PS_DIFF_3P write exit errorlevel=!errorlevel!
    echo [DEBUG] Generated PS_DIFF_3P contents:
    type "!PS_DIFF_3P!" 2>nul
    echo [DEBUG] Executing PS_DIFF_3P...
    )

    powershell -NoProfile -ExecutionPolicy Bypass -File "!PS_DIFF_3P!"
    if "%DEBUG%"=="1" echo [DEBUG] PS_DIFF_3P execution exit errorlevel=!errorlevel!

    echo Saved unplaced user app list to: "!UNPLACED_OUT!"
    echo.

    if not "%DEBUG%"=="1" (
    del "!PM_3P_FILE!" >nul 2>&1
    del "!NOVA_PKGS_FILE!" >nul 2>&1
    del "!PS_DIFF_3P!" >nul 2>&1
    del "!SQL_NOVA_PKGS!" >nul 2>&1
    ) else (
    echo [DEBUG] Keeping temp files because DEBUG=1:
    echo [DEBUG] "!PM_3P_FILE!"
    echo [DEBUG] "!NOVA_PKGS_FILE!"
    echo [DEBUG] "!PS_DIFF_3P!"
    echo [DEBUG] "!SQL_NOVA_PKGS!"
    )

    :quit_script
    pause
    exit /b 0

    :: -------------------------------------------------------------------------
    :: Subroutine: scan_pane <pane_number>
    :: -------------------------------------------------------------------------
    :scan_pane
    set "SCR=%~1"

    "%SQLITE_EXE%" -cmd ".separator |" "%DB_PATH%" "SELECT _id, CASE WHEN title IS NULL OR TRIM(title) = '' THEN '(Untitled Folder)' ELSE title END FROM favorites WHERE itemType = 2 AND container = -100 AND CAST(screen AS INTEGER) = %SCR% ORDER BY cellY, cellX, rank, _id;" > "%TEMP%\nova_pane_folders.txt" 2>nul

    set "LOOSE_CNT=0"
    "%SQLITE_EXE%" "%DB_PATH%" "SELECT COUNT(*) FROM favorites WHERE container = -100 AND CAST(screen AS INTEGER) = %SCR% AND itemType <> 2;" > "%TEMP%\nova_pane_loose_cnt.txt" 2>nul

    for /f "usebackq delims=" %%C in ("%TEMP%\nova_pane_loose_cnt.txt") do (
    if not "%%C"=="" set "LOOSE_CNT=%%C"
    )
    del "%TEMP%\nova_pane_loose_cnt.txt" >nul 2>&1

    set "HAS_PANE_FOLDERS=0"
    for /f "usebackq tokens=1* delims=|" %%A in ("%TEMP%\nova_pane_folders.txt") do (
    set "FID=%%A"
    if not "!FID!"=="" set "HAS_PANE_FOLDERS=1"
    )

    set "PRINT_HEADER=0"
    if !HAS_PANE_FOLDERS! GTR 0 set "PRINT_HEADER=1"
    if !LOOSE_CNT! GTR 0 set "PRINT_HEADER=1"

    if "!PRINT_HEADER!"=="1" echo pane %SCR%

    for /f "usebackq tokens=1* delims=|" %%A in ("%TEMP%\nova_pane_folders.txt") do (
    set "FID=%%A"
    set "FNAME=%%B"
    set "FNAME=!FNAME:^M=!"
    if not "!FID!"=="" (
    set /a TGT_COUNT+=1
    set "TGT_LABEL_!TGT_COUNT!=pane %SCR% - !FNAME!"
    set "TGT_WHERE_!TGT_COUNT!=f.container = !FID!"
    set "TGT_ORDER_!TGT_COUNT!=f.rank, f._id"
    set "LISTED_FOLDER_IDS=!LISTED_FOLDER_IDS!!FID!,"
    echo [!TGT_COUNT!] !FNAME!
    )
    )

    if !LOOSE_CNT! GTR 0 (
    set /a TGT_COUNT+=1
    set "TGT_LABEL_!TGT_COUNT!=pane %SCR% loose apps"
    set "TGT_WHERE_!TGT_COUNT!=f.container = -100 AND CAST(f.screen AS INTEGER) = %SCR% AND f.itemType <> 2"
    set "TGT_ORDER_!TGT_COUNT!=f.cellY, f.cellX, f.rank, f._id"
    echo [!TGT_COUNT!] pane %SCR% loose apps
    )

    del "%TEMP%\nova_pane_folders.txt" >nul 2>&1
    goto :eof
    :: -------------------------------------------------------------------------
    :: end of adbfolder.bat
    :: -------------------------------------------------------------------------
    :: Step by step description of what this script does
    :: 1. Environment & Configuration Setup
    :: A. Command environment
    :: a. Disables command echoing and enables delayed expansion
    :: b. Sets the working directory to the script's path
    :: B. Configuration variables
    :: a. Sets default configuration paths for ADB, SQLite
    :: and work directories
    :: b. Defines the DEBUG toggle flag
    :: 2. Dependency Verification
    :: A. Executable checks
    :: a. Locates adb.exe and checks system PATH or configured fallback path
    :: b. Locates sqlite3.exe and exits with an error if missing
    :: B. Directory setup
    :: a. Creates the local working directory if it does not exist
    :: 3. Source Selection Menu
    :: A. Choice [1]: Pull from Android via ADB
    :: a. Detects connected ADB device target
    :: b. Lists .novabackup files in the remote backup directory
    :: with fallback search
    :: c. Prompts user to select or enter a backup filename/path
    :: d. Pulls the selected .novabackup file to the Windows workspace
    :: e. Renames the pulled file to backup.zip and extracts it
    :: into backup_extracted to retrieve nova.db
    :: B. Choice [2]: Use Local Database / Archive
    :: a. Prompts user for a custom path to nova.db .novabackup or .zip
    :: with a retry loop
    :: b. Validates file existence
    :: c. Automatically extracts archives if .novabackup or .zip file
    :: 4. Database Verification & Target Enumeration
    :: A. Database validation
    :: a. Verifies that nova.db exists at the target path
    :: B. Section 1 [Dock]
    :: a. Scans dock apps [container = -101]
    :: b. Scans and lists any dock folders
    :: C. Section 2 [Panes 0-14]
    :: a. Iterates through home screen panes 0 to 14
    :: via the scan_pane subroutine
    :: b. Queries pane folders [itemType = 2, container = -100]
    :: c. Checks for loose non-folder apps [itemType <> 2] on the pane
    :: D. Section 3 [Other Folders]
    :: a. Searches for orphaned folders not categorized under dock or panes
    :: b. Lists and registers valid other folders
    :: 5. User Selection & Query Execution [run_query]
    :: A. Selection & Sanity
    :: a. Prompts user to select a target number or quit [q or 0]
    :: b. Sanitizes the selected label using a temporary PowerShell
    :: script to generate a safe filename
    :: B. Query Generation & Execution
    :: a. Writes a dynamic SQLite query script to a temp file
    :: [.sql] extracting item ID, app title, package name and raw intent
    :: b. Executes the query against nova.db using sqlite3.exe
    :: C. Output & Formatting
    :: a. Formats output columns [package_name first, display_name second]
    :: into an auto-sized table via PowerShell
    :: b. Adds a descriptive pane/folder heading and indents the table
    :: by two spaces for easier reading and future concatenation
    :: c. Saves raw results [output.txt] and formatted results
    :: [target_apps.txt] to the work directory
    :: d. Appends each formatted export with a timestamp to
    :: [adbfolder_log.txt] without overwriting previous exports
    :: e. Prompts user to loop back to scan another folder/pane or proceed
    :: 6. Optional Unplaced Third-Party Package Check [check_missing_3p]
    :: A. Pre-check Validation
    :: a. Prompts user whether to check for user-installed packages
    :: [-3] missing from the Nova layout
    :: b. Verifies ADB device connectivity and database availability
    :: c. Optionally prompts user to resolve app labels via adb dumpsys
    :: and aapt/aapt2
    :: B. Data Collection
    :: a. Queries installed third-party packages from device
    :: [adb shell pm list packages -3]
    :: b. Queries all referenced packages inside nova.db
    :: C. Diff Analysis & Cleanup
    :: a. Generates and executes a PowerShell diff script to find
    :: installed packages with no home screen icon
    :: b. Outputs a formatted table of unplaced apps to
    :: unplaced_user_apps.txt
    :: c. Cleans up temporary script and text files
    :: [unless DEBUG=1] and exits cleanly
    :: -------------------------------------------------------------------------
    :: Not only is there a question of how to port this for more general use,
    :: but there's also a question of which common launchers will it work with.
    ::
    :: It may be that the native Android launcher may provide a 'parsable
    :: homescreen, so I looked up which might work in addition to Nova Launcher.
    ::
    :: So far, I "think" [tentatively] these will export/import a homescreen.
    :: a. Nova [SQL, .novabackup/nova.db restore]
    :: b. Lawnchair [.lawnchairbackup/restore]
    :: c. Mink [JSON backup/restore]
    :: d. Total Launcher [zip? backup/restore]
    :: e. Niagra [nlb backup/restore]
    :: d. Others? [SQLite, JSON, XML, etc.]
    :: ------------------------------------------------------------------------- --
    Some people are on Usenet for their amusement but I'm here to get things done. --- Synchronet 3.22a-Linux NewsLink 1.2
  • From Maria Sophia@mariasophia@comprehension.com to comp.lang.python,alt.os.linux,comp.sys.mac.system,alt.comp.os.windows-11 on Sat Nov 21 22:44:27 2026
    From Newsgroup: alt.comp.os.windows-11

    Here is v1p6 of adbfolder.py which is a port of v6p1 of adbfolder.bat
    (since it took a half dozen iterations to make the python port work).

    Interestingly, a couple of bugs showed up when I was porting because the Python code worked differently, which actually turned out to be a blessing
    as the python code was working correctly & the Windows batch was not.

    That descrepancy enabled me to find the syntactical bug in the Windows
    batch script, which was easy to solve but not so easy to identify.

    :: v6p0 20261121 Fixed ADB shell ls wildcard expansion by moving the closing
    :: quote after %ANDROID_BCK_DIR% so *.novabackup is not treated
    :: as a literal filename (which had forced a global search)

    What I learned from that effort is it's sometimes useful to port your code
    to another format and then when you run it, you might find syntax issues.

    Anyway, here's the working python code, which I only tested on Windows, but which should work on any platform, as I'm all about leveraging solutions.

    #!/usr/bin/env python3
    # -------------------------------------------------------------------------
    # adbfolder.py
    # Usage: python adbfolder.py
    # -------------------------------------------------------------------------
    # Outputs a perfect textual inventory, with debug capability, of an Android
    # homescreen, including location of all panes, folders, packages and titles.
    #
    # Requires adb, sqlite3, tabulate and optionally aapt/aapt2
    #
    # Intended to assist in debugging, inventory, archival, backup and restore.
    # Runs on Windows over Wi-Fi/USB, but can be ported to other platforms.
    #
    # Will pull a backup from android via adb or read an existing nova db or
    # nova backup archive on windows needing only adb and sql dependencies
    #
    # List order is top to bottom, left to right, meaning the leftmost pane
    # is 1st, then subsequent panes, from 0 to 1 to 2 and so on to the right.
    #
    # Similarly, the topleft folder is 1st, then the next folder to the right.
    #
    # Likewise, packages and titles inside of folders are listed in top to
    # bottom order, left to right, providing an exact textual description.
    #
    # Bare icons, not inside folders, are listed separately as a line item.
    # The dock and folders in the dock are treated much like the panes are.
    #
    # This script not only provides a textual inventory of the name and
    # homescreen location of every folder name, package name and display
    # name ever added to the homescreen, but it optionally will 'diff'
    # against packages which were manually installed by the user but
    # which have no current homescreen icon (i.e., "headless" apps).
    #
    # Note the display_name is the current icon title for a given app icon,
    # which can be changed by the user, so it's not always the original.
    # However, for apps installed by the user but without homescreen icons,
    # the optional lookup pulls the app's original defined Android app_label.
    #
    # Output is appended to a timestamped running log file for traceability.
    # Unless the user wipes out the running log, this becomes an automatic
    # audit of all the physical changes a user has made to the homescreen.
    # -------------------------------------------------------------------------
    # Q: Why is saying YES to "Resolve app titles via adb/aapt" very slow?
    # A: For each of the unplaced packages, the script does:
    # a. adb shell dumpsys package <pkg> to look for nonLocalizedLabel=
    # b. If that fails: adb shell pm path <pkg> to find the APK location
    # c. adb pull <apk> to download the APK to the PC
    # d. aapt dump badging <apk> to read the app label from the APK
    # Which is up to 4 ADB commands times N apps = 4N round-trips.
    # Over USB, each round-trip is fast (milliseconds).
    # But, over Wi-Fi, each one has wireless handshake latency,
    # so the total time adds up just waiting on ADB to return results.
    # -------------------------------------------------------------------------
    # v1p6 20261121 Ported to adbfolder.py v1p6 (took a half-dozen iterations)
    # Matched output of abfolder.bat v6p1 with adbfolder.py v1p6
    # v1p0 20261121 First attempt at porting adbfolder.bat to adbfolder.py
    # -------------------------------------------------------------------------

    import os
    import sys
    import re
    import subprocess
    import shutil
    import sqlite3
    import zipfile
    import logging
    from pathlib import Path
    from datetime import datetime
    from tabulate import tabulate

    # ---------------------------------------------------------------------------
    # Configuration
    # ---------------------------------------------------------------------------
    DEBUG = False # set True for verbose traces

    ADB_EXE = Path(r"C:\app\editor\android\scrcpy\adb.exe")
    SQLITE_EXE = Path(r"C:\app\editor\android\sdk\platform-tools\sqlite3.exe")
    WORK_DIR = Path(r"C:\app\editor\android\scrcpy\nova")
    ANDROID_BCK_DIR = "/storage/emulated/0/0000/bck/nova_backup"
    DEFAULT_CONTAINER = 2921

    TEMP = Path(os.environ.get("TEMP", Path.home() / "tmp"))


    def debug(msg):
    if DEBUG:
    print(f"[DEBUG] {msg}")


    # ---------------------------------------------------------------------------
    # Helpers
    # ---------------------------------------------------------------------------
    def run(cmd, **kwargs):
    """Run a command and return CompletedProcess."""
    debug(f"Running: {' '.join(map(str, cmd))}")
    return subprocess.run(cmd, capture_output=True, text=True, **kwargs)


    def which(exe_name):
    """Return path to executable if found in PATH or configured paths."""
    found = shutil.which(exe_name)
    return found


    def ensure_dir(path: Path):
    path.mkdir(parents=True, exist_ok=True)


    def prompt(msg, default=None):
    if default is not None:
    msg = f"{msg} [Default: {default}]: "
    else:
    msg = f"{msg}: "
    val = input(msg).strip()
    return val if val else (default or "")


    def yes_no(msg, default="n"):
    val = prompt(f"{msg} [y/N]" if default != "y" else f"{msg} [Y/n]", default)
    return val.lower().startswith("y")


    # ---------------------------------------------------------------------------
    # Dependency check
    # ---------------------------------------------------------------------------
    def check_dependencies():
    print("Checking required tools (adb and sqlite3) ...")

    # ADB
    global ADB_EXE
    path_adb = which("adb")
    if not ADB_EXE.exists():
    if path_adb:
    print(f"[INFO] Configured ADB_EXE not found; using PATH: {path_adb}")
    ADB_EXE = Path(path_adb)
    else:
    print(f"[WARN] adb.exe not found at '{ADB_EXE}' and not in PATH.")
    else:
    if not path_adb:
    print(f"[INFO] adb.exe found at configured path, though not in PATH.")

    # SQLite
    global SQLITE_EXE
    path_sqlite = which("sqlite3")
    if not SQLITE_EXE.exists():
    if path_sqlite:
    print(f"[INFO] Configured SQLITE_EXE not found; using PATH: {path_sqlite}")
    SQLITE_EXE = Path(path_sqlite)
    else:
    print(f"[ERROR] sqlite3.exe not found at '{SQLITE_EXE}' and not in PATH.")
    input("Press Enter to exit...")
    sys.exit(1)
    else:
    if not path_sqlite:
    print(f"[INFO] sqlite3.exe found at configured path, though not in PATH.")

    ensure_dir(WORK_DIR)

    print(f"Working directory: {Path.cwd()}")
    print(f"Nova work directory: {WORK_DIR}")
    print("----------------")
    print()


    # ---------------------------------------------------------------------------
    # ADB helpers
    # ---------------------------------------------------------------------------
    def adb_devices():
    """Return list of connected device serials."""
    res = run([str(ADB_EXE), "devices"])
    devices = []
    for line in res.stdout.strip().splitlines()[1:]:
    parts = line.split()
    if parts and "\t" in line or len(parts) >= 2:
    serial = parts[0]
    state = parts[1] if len(parts) > 1 else ""
    if state == "device":
    devices.append(serial)
    return devices


    def adb_shell(serial, cmd):
    return run([str(ADB_EXE), "-s", serial, "shell", cmd])


    def adb_pull(serial, remote, local):
    return run([str(ADB_EXE), "-s", serial, "pull", remote, str(local)])


    def adb_push(serial, local, remote):
    return run([str(ADB_EXE), "-s", serial, "push", str(local), remote])


    # ---------------------------------------------------------------------------
    # Backup pull from Android
    # ---------------------------------------------------------------------------
    def pull_from_android():
    print("--- Pull Nova Backup from Android ---")

    if not ADB_EXE.exists():
    print(f"[ERROR] adb.exe not found at: '{ADB_EXE}'")
    input("Press Enter to exit...")
    sys.exit(1)

    devices = adb_devices()
    if not devices:
    print("[ERROR] No connected ADB devices found.")
    input("Press Enter to exit...")
    sys.exit(1)

    serial = devices[0]
    debug(f"ADB_TARGET={serial}")
    print(f"Targeting device: {serial}")

    make_bck = yes_no("Open Nova Launcher settings on device to create a new backup first?")
    if make_bck:
    print("Launching Nova Launcher settings on device ...")
    print("Tap Backup & restore > Backup > Save to save to your device")
    run([
    str(ADB_EXE), "-s", serial, "shell",
    "am", "start",
    "-n",
    "com.teslacoilsw.launcher/com.teslacoilsw.launcher.preferences.SettingsActivity"
    ])
    input("Create your backup in Nova Launcher on the device, then press ENTER to list backups.")

    print(f"Listing backups in {ANDROID_BCK_DIR} ...")
    print()

    # List backups in default dir
    res = adb_shell(serial, f"ls -1t '{ANDROID_BCK_DIR}'/*.novabackup 2>/dev/null")

    backups = parse_adb_lines(res.stdout)

    if not backups:
    print(f"[INFO] No .novabackup files found in {ANDROID_BCK_DIR}.")
    print("Searching Android storage for *.novabackup files ...")
    print()

    search_cmd = (
    "for d in /storage/emulated/0 /storage/*; "
    "do [ -d \"$d\" ] && [ \"$d\" != \"/storage/emulated\" ] && "
    "find \"$d\" -maxdepth 5 -name '*.novabackup' 2>/dev/null; done"
    )
    res = adb_shell(serial, search_cmd)
    backups = parse_adb_lines(res.stdout)

    if not backups:
    print(f"[WARN] No .novabackup files found in {ANDROID_BCK_DIR} or Android storage.")
    remote_bck = manual_backup_path()
    else:
    print()
    for i, (fname, fpath) in enumerate(backups, 1):
    print(f" [{i}] {fname}")
    pick = prompt(f"Select backup number [1-{len(backups)}, Default: 1]", "1")
    try:
    idx = int(pick) - 1
    if not (0 <= idx < len(backups)):
    raise ValueError
    except ValueError:
    # Treat as manual path
    remote_bck = manual_backup_path(pick)
    else:
    fname, fpath = backups[idx]
    remote_bck = fpath

    return download_and_extract(serial, remote_bck)


    def parse_adb_lines(text):
    """Parse ADB output into list of (filename, fullpath)."""
    results = []
    for line in text.splitlines():
    line = line.strip().replace("\r", "")
    if not line:
    continue
    path = Path(line)
    fname = path.name
    results.append((fname, line))
    # Newest first, matching `ls -1t`
    results.sort(key=lambda x: x[0], reverse=True)
    return results

    def manual_backup_path(prefill=""):
    if prefill:
    bck_file = prefill.strip().strip('"')
    else:
    bck_file = prompt(
    "Enter backup filename or full Android path "
    "e.g. 2026-11-19_12-57.novabackup"
    )
    if not bck_file:
    print("[ERROR] No backup filename provided.")
    input("Press Enter to exit...")
    sys.exit(1)

    remote_bck = bck_file
    if not remote_bck.startswith("/"):
    remote_bck = f"{ANDROID_BCK_DIR}/{remote_bck}"
    fname = Path(remote_bck).name
    return remote_bck


    def download_and_extract(serial, remote_bck):
    local_bck = WORK_DIR / Path(remote_bck).name
    local_zip = WORK_DIR / "backup.zip"
    extract_dir = WORK_DIR / "backup_extracted"

    print()
    print(f'Pulling "{remote_bck}" to "{local_bck}" ...')
    res = adb_pull(serial, remote_bck, local_bck)
    if res.returncode != 0:
    print("[ERROR] Failed to pull backup from Android.")
    input("Press Enter to exit...")
    sys.exit(1)

    if local_zip.exists():
    local_zip.unlink()

    # Rename pulled file to backup.zip
    shutil.move(str(local_bck), str(local_zip))

    if extract_dir.exists():
    shutil.rmtree(extract_dir)

    print(f"Extracting backup.zip to '{extract_dir}' ...")
    try:
    with zipfile.ZipFile(local_zip, "r") as zf:
    zf.extractall(extract_dir)
    except Exception as e:
    print(f"[ERROR] Failed to extract backup.zip: {e}")
    input("Press Enter to exit...")
    sys.exit(1)

    db_path = extract_dir / "nova.db"
    return db_path


    # ---------------------------------------------------------------------------
    # Local source selection
    # ---------------------------------------------------------------------------
    def use_local_source():
    print("--- Local Database Selection ---")
    print(f'Enter the path to nova.db or a .novabackup or .zip file.')
    print(f'Default: {WORK_DIR / "backup_extracted" / "nova.db"}')
    print()

    while True:
    user_db = prompt("Path to database or backup file [Enter for default]")
    if not user_db:
    db_path = WORK_DIR / "backup_extracted" / "nova.db"
    else:
    user_db = user_db.strip().strip('"')
    db_path = Path(user_db).resolve()

    if not db_path.exists():
    print(f"[ERROR] File not found: '{db_path}'")
    retry = prompt("Try again? [Y/n]", "y")
    if retry.lower().startswith("n"):
    sys.exit(1)
    continue

    ext = db_path.suffix.lower()
    if ext == ".novabackup":
    return extract_local_archive(db_path, restore_prompt=True)
    elif ext == ".zip":
    return extract_local_archive(db_path, restore_prompt=False)
    else:
    return db_path


    def extract_local_archive(archive_path, restore_prompt=False):
    extract_dir = WORK_DIR / "backup_extracted"
    if extract_dir.exists():
    shutil.rmtree(extract_dir)

    print(f'Extracting "{archive_path}" to "{extract_dir}" ...')
    try:
    with zipfile.ZipFile(archive_path, "r") as zf:
    zf.extractall(extract_dir)
    except Exception as e:
    print(f"[ERROR] Failed to extract archive: {e}")
    input("Press Enter to exit...")
    sys.exit(1)

    db_path = extract_dir / "nova.db"

    if restore_prompt and yes_no("Restore this backup in Nova on the connected device?"):
    restore_backup_to_device(db_path)

    return db_path


    def restore_backup_to_device(db_path):
    if not ADB_EXE.exists():
    print(f"[ERROR] adb.exe not found at '{ADB_EXE}'; cannot send backup to device.")
    input("Press Enter to exit...")
    sys.exit(1)

    devices = adb_devices()
    if not devices:
    print("[ERROR] No connected ADB device found; cannot restore the backup.")
    input("Press Enter to exit...")
    sys.exit(1)

    serial = devices[0]
    nova_backup_dir = "/storage/emulated/0/Android/data/com.teslacoilsw.launcher/files/Backup"

    print(f'Copying "{db_path}" to Nova backup folder on {serial} ...')
    adb_shell(serial, f"mkdir -p '{nova_backup_dir}'")
    res = adb_push(serial, db_path, nova_backup_dir + "/")
    if res.returncode != 0:
    print("[ERROR] Failed to copy the backup to the device.")
    input("Press Enter to exit...")
    sys.exit(1)

    print(f"Launching Nova Launcher settings on {serial} ...")
    run([
    str(ADB_EXE), "-s", serial, "shell",
    "am", "start",
    "-n",
    "com.teslacoilsw.launcher/com.teslacoilsw.launcher.preferences.SettingsActivity"
    ])
    print("In Nova, choose Backup & restore and restore the backup you copied.")


    # ---------------------------------------------------------------------------
    # SQLite helpers (use Python sqlite3 module, fall back to CLI)
    # ---------------------------------------------------------------------------
    def sqlite_query(db_path, sql, params=()):
    """Execute a SELECT query using Python sqlite3. Returns list of tuples."""
    try:
    conn = sqlite3.connect(str(db_path))
    cur = conn.execute(sql, params)
    rows = cur.fetchall()
    conn.close()
    return rows
    except sqlite3.Error as e:
    print(f"[ERROR] SQLite query failed: {e}")
    input("Press Enter to exit...")
    sys.exit(1)


    def sqlite_query_cli(db_path, sql, params=()):
    """Fallback: write SQL to temp file and run sqlite3 CLI."""
    sql_file = TEMP / "adbfolder_query.sql"
    sql_file.write_text(sql, encoding="utf-8")
    res = run([str(SQLITE_EXE), str(db_path)], input=sql, text=True)
    if res.returncode != 0:
    print(f"[ERROR] sqlite3 CLI failed: {res.stderr}")
    input("Press Enter to exit...")
    sys.exit(1)
    rows = []
    for line in res.stdout.strip().splitlines():
    rows.append(tuple(line.split("\t")))
    return rows


    # ---------------------------------------------------------------------------
    # Target enumeration
    # ---------------------------------------------------------------------------
    class Target:
    def __init__(self, num, label, where, order):
    self.num = num
    self.label = label
    self.where = where
    self.order = order


    def enumerate_targets(db_path):
    targets = []
    tgt_count = 0
    listed_folder_ids = set()

    # 1. Dock
    print("dock")
    tgt_count += 1
    targets.append(Target(tgt_count, "dock apps", "f.container = -101",
    "f.screen, f.cellY, f.cellX, f.rank, f._id"))
    print(f" [{tgt_count}] dock apps")

    rows = sqlite_query(db_path,
    "SELECT _id, COALESCE(NULLIF(TRIM(title), ''), '(Untitled Folder)') "
    "FROM favorites WHERE itemType = 2 AND container = -101 "
    "ORDER BY cellY, cellX, rank, _id")
    for fid, fname in rows:
    tgt_count += 1
    label = f"dock - {fname}"
    targets.append(Target(tgt_count, label, f"f.container = {fid}",
    "f.rank, f._id"))
    listed_folder_ids.add(str(fid))
    print(f" [{tgt_count}] {fname}")

    # 2. Panes 0-14
    for pane in range(15):
    tgt_count = scan_pane(db_path, pane, targets, tgt_count, listed_folder_ids)

    # 3. Other folders (orphaned folders not under dock or a pane)
    rows = sqlite_query(db_path,
    "SELECT _id, COALESCE(NULLIF(TRIM(title), ''), '(Untitled Folder)') "
    "FROM favorites WHERE itemType = 2 "
    "ORDER BY LOWER(title), _id")
    other_has_folders = False
    for fid, fname in rows:
    if str(fid) in listed_folder_ids:
    continue
    if not other_has_folders:
    print("other")
    other_has_folders = True
    tgt_count += 1
    label = f"other - {fname}"
    targets.append(Target(tgt_count, label, f"f.container = {fid}",
    "f.rank, f._id"))
    print(f" [{tgt_count}] {fname}")

    return targets, tgt_count


    def scan_pane(db_path, pane, targets, tgt_count, listed_folder_ids):
    rows = sqlite_query(db_path,
    "SELECT _id, COALESCE(NULLIF(TRIM(title), ''), '(Untitled Folder)') "
    "FROM favorites WHERE itemType = 2 AND container = -100 "
    "AND CAST(screen AS INTEGER) = ? "
    "ORDER BY cellY, cellX, rank, _id", (pane,))

    loose_cnt = sqlite_query(db_path,
    "SELECT COUNT(*) FROM favorites WHERE container = -100 "
    "AND CAST(screen AS INTEGER) = ? AND itemType <> 2", (pane,))[0][0]

    has_pane_folders = len(rows) > 0
    print_header = has_pane_folders or loose_cnt > 0

    if print_header:
    print(f"pane {pane}")

    for fid, fname in rows:
    tgt_count += 1
    label = f"pane {pane} - {fname}"
    targets.append(Target(tgt_count, label, f"f.container = {fid}",
    "f.rank, f._id"))
    listed_folder_ids.add(str(fid))
    print(f" [{tgt_count}] {fname}")

    if loose_cnt > 0:
    tgt_count += 1
    label = f"pane {pane} loose apps"
    where = (f"f.container = -100 AND CAST(f.screen AS INTEGER) = {pane} "
    f"AND f.itemType <> 2")
    order = "f.cellY, f.cellX, f.rank, f._id"
    targets.append(Target(tgt_count, label, where, order))
    print(f" [{tgt_count}] pane {pane} loose apps")

    return tgt_count

    # ---------------------------------------------------------------------------
    # Sanitize label -> safe filename
    # ---------------------------------------------------------------------------
    def sanitize_label(label):
    safe = re.sub(r'[\\/:*?"<>|() ]+', '_', label).strip('_')
    if not safe:
    safe = "nova_target"
    return safe


    # ---------------------------------------------------------------------------
    # Run query and format output
    # ---------------------------------------------------------------------------
    def run_query(db_path, target, work_dir):
    safe_name = sanitize_label(target.label)
    raw_out = work_dir / "output.txt"
    clean_out = work_dir / f"{safe_name}_apps.txt"
    log_out = work_dir / "adbfolder_log.txt"

    sql = f"""
    SELECT f._id AS item_id,
    f.title AS display_name,
    CASE
    WHEN f.iconPackage IS NOT NULL AND LENGTH(TRIM(f.iconPackage)) > 0
    THEN TRIM(f.iconPackage)
    WHEN INSTR(f.intent, 'component=') > 0 THEN
    CASE
    WHEN INSTR(SUBSTR(f.intent, INSTR(f.intent, 'component=') + 10), '/') > 0
    THEN SUBSTR(SUBSTR(f.intent, INSTR(f.intent, 'component=') + 10),
    1, INSTR(SUBSTR(f.intent, INSTR(f.intent, 'component=') + 10), '/') - 1)
    WHEN INSTR(SUBSTR(f.intent, INSTR(f.intent, 'component=') + 10), ';') > 0
    THEN SUBSTR(SUBSTR(f.intent, INSTR(f.intent, 'component=') + 10),
    1, INSTR(SUBSTR(f.intent, INSTR(f.intent, 'component=') + 10), ';') - 1)
    ELSE SUBSTR(f.intent, INSTR(f.intent, 'component=') + 10)
    END
    WHEN INSTR(f.intent, 'package=') > 0 THEN
    CASE
    WHEN INSTR(SUBSTR(f.intent, INSTR(f.intent, 'package=') + 8), ';') > 0
    THEN SUBSTR(SUBSTR(f.intent, INSTR(f.intent, 'package=') + 8),
    1, INSTR(SUBSTR(f.intent, INSTR(f.intent, 'package=') + 8), ';') - 1)
    ELSE SUBSTR(f.intent, INSTR(f.intent, 'package=') + 8)
    END
    ELSE ''
    END AS package_name,
    f.intent
    FROM favorites f
    WHERE {target.where}
    ORDER BY {target.order};
    """

    print()
    print(f'Querying "{target.label}" ...')

    try:
    rows = sqlite_query(db_path, sql)
    except SystemExit:
    rows = sqlite_query_cli(db_path, sql)

    # Write raw tab-delimited output (all columns)
    with open(raw_out, "w", encoding="utf-8") as f:
    f.write("item_id\tdisplay_name\tpackage_name\tintent\n")
    for row in rows:
    f.write("\t".join(str(c) if c is not None else "" for c in row) + "\n")

    # Format only package_name and display_name, in that order
    display_rows = [(row[2], row[1]) for row in rows] # (package_name, display_name)

    table_text = ""
    if display_rows:
    table_text = tabulate(
    display_rows,
    headers=["package_name", "display_name"],
    tablefmt="plain"
    )

    indented = [" " + line for line in table_text.splitlines()]

    # Header matching batch format
    if target.label.startswith("pane ") and " - " in target.label:
    parts = target.label.split(" - ", 1)
    pane_num = parts[0].replace("pane ", "").strip()
    folder_name = parts[1]
    header = f' pane {pane_num} folder "{folder_name}"'
    else:
    header = f" {target.label}"

    clean_text = header + "\n" + "\n".join(indented) + "\n"

    # Write clean output
    clean_out.write_text(clean_text, encoding="utf-8")

    # Append to running log
    timestamp = datetime.now().strftime("%Y-%m-%d %H:%M:%S")
    entry = (
    "\n============================================================\n"
    f"Export: {timestamp}\n"
    f"{clean_text}"
    )
    with open(log_out, "a", encoding="utf-8") as f:
    f.write(entry)

    print()
    print(f"--- Result ({clean_out}) ---")
    print()
    print(clean_text)
    print(f"Raw tab-delimited output saved to: {raw_out}")
    print(f"Formatted app list saved to: {clean_out}")
    print(f"Running export log saved to: {log_out}")
    print()

    return clean_out

    # ---------------------------------------------------------------------------
    # Optional: check missing third-party packages
    # ---------------------------------------------------------------------------
    def check_missing_3p(serial, db_path, work_dir):
    print()
    if not yes_no("Check user apps -3 with no icon in Nova before quitting?"):
    return

    if not ADB_EXE.exists():
    print(f"[INFO] adb.exe not found at '{ADB_EXE}'; skipping device package check.")
    return

    devices = adb_devices()
    if not devices:
    print("[INFO] No connected ADB device found; skipping device package check.")
    return
    target_serial = devices[0]
    debug(f"RUN_ADB_TARGET={target_serial}")

    if not db_path or not db_path.exists():
    print("[INFO] Nova database not available; skipping device package check.")
    return

    resolve_labels = yes_no("Resolve app titles via adb/aapt slower over Wi-Fi?", default="n")
    do_resolve = resolve_labels

    pm_3p_file = TEMP / "adbfolder_pm3.txt"
    nova_pkgs_file = TEMP / "adbfolder_nova_pkgs.txt"
    unplaced_out = work_dir / "unplaced_user_apps.txt"

    print(f"Querying third-party packages from device {target_serial} ...")
    res = adb_shell(target_serial, "pm list packages -3 2>/dev/null")
    pm_3p_file.write_text(res.stdout, encoding="utf-8")

    installed3 = set()
    for line in pm_3p_file.read_text(encoding="utf-8").splitlines():
    p = line.replace("\r", "").strip()
    if p.startswith("package:"):
    p = p[8:].strip()
    if p:
    installed3.add(p)

    print("Querying packages referenced anywhere in nova.db ...")
    rows = sqlite_query(db_path,
    "SELECT DISTINCT package_name FROM ("
    " SELECT CASE"
    " WHEN iconPackage IS NOT NULL AND LENGTH(TRIM(iconPackage)) > 0"
    " THEN TRIM(iconPackage)"
    " WHEN INSTR(intent, 'component=') > 0 THEN"
    " CASE"
    " WHEN INSTR(SUBSTR(intent, INSTR(intent, 'component=') + 10), '/') > 0"
    " THEN SUBSTR(SUBSTR(intent, INSTR(intent, 'component=') + 10),"
    " 1, INSTR(SUBSTR(intent, INSTR(intent, 'component=') + 10), '/') - 1)"
    " ELSE SUBSTR(intent, INSTR(intent, 'component=') + 10)"
    " END"
    " ELSE ''"
    " END AS package_name"
    " FROM favorites"
    ")"
    "WHERE LENGTH(package_name) > 0")

    in_nova = set()
    for (pkg,) in rows:
    if pkg:
    in_nova.add(pkg)

    missing = sorted(installed3 - in_nova, key=str.lower)

    results = []
    for i, pkg in enumerate(missing, 1):
    label = ""
    if do_resolve:
    if i % 10 == 1 or i == len(missing):
    print(f"Resolving titles: {i}/{len(missing)} ({pkg})...")
    dump = adb_shell(target_serial, f"dumpsys package {pkg} 2>/dev/null")
    for dl in dump.stdout.splitlines():
    m = re.search(r'nonLocalizedLabel="([^"]+)"', dl)
    if m:
    label = m.group(1).strip()
    if not label:
    # Try aapt path
    apk_path = shutil.which("aapt") or shutil.which("aapt2")
    if apk_path:
    path_res = adb_shell(target_serial, f"pm path {pkg} 2>/dev/null")
    for pl in path_res.stdout.splitlines():
    pl = pl.strip()
    if pl.startswith("package:"):
    apk_remote = pl[8:].strip()
    apk_local = TEMP / "adbfolder_probe.apk"
    pull_res = adb_pull(target_serial, apk_remote, apk_local)
    if pull_res.returncode == 0 and apk_local.exists():
    badging = run([apk_path, "dump", "badging", str(apk_local)],
    capture_output=True, text=True)
    for bl in badging.stdout.splitlines():
    m = re.match(r"^application-label:'([^']+)'", bl)
    if m:
    label = m.group(1).strip()
    break
    try:
    apk_local.unlink()
    except Exception:
    pass
    break
    results.append((pkg, label))

    # Write output
    lines = []
    if results:
    lines.append(tabulate(results, headers=["package_name", "app_title"],
    tablefmt="plain").splitlines())
    flat = []
    for group in lines:
    flat.extend(group)
    table_text = "\n".join(flat) + ("\n" if flat else "")
    unplaced_out.write_text(table_text, encoding="utf-8")

    print()
    print(f"User packages (-3): {len(installed3)} | "
    f"In Nova layout: {len(in_nova)} | "
    f"No icon in Nova: {len(missing)}")
    if results:
    print()
    print(table_text.rstrip())
    print(f"Saved unplaced user app list to: {unplaced_out}")
    print()

    # Cleanup temp files unless debug
    if not DEBUG:
    for f in [pm_3p_file, nova_pkgs_file]:
    try:
    f.unlink()
    except Exception:
    pass


    # ---------------------------------------------------------------------------
    # Main
    # ---------------------------------------------------------------------------
    def main():
    global DEBUG
    # Allow env override
    if os.environ.get("ADBFOLDER_DEBUG", "0") == "1":
    DEBUG = True

    check_dependencies()

    print("Select source for Nova Launcher database:")
    print("[1] Pull .novabackup from Android via ADB and extract nova.db [Default]")
    print("[2] Use an existing nova.db or .novabackup or .zip already on Windows")
    print()

    src_choice = prompt("Enter choice [1 or 2]", "1")

    if src_choice == "2":
    db_path = use_local_source()
    else:
    db_path = pull_from_android()

    if not db_path or not db_path.exists():
    print(f"[ERROR] nova.db not found at: '{db_path}'")
    input("Press Enter to exit...")
    sys.exit(1)

    print()
    print(f"Using database: {db_path}")
    print("Scanning Nova Launcher dock, panes and folders ...")
    print()

    targets, tgt_count = enumerate_targets(db_path)

    print()
    pick = prompt(f"Select number [1-{tgt_count}, q to quit]")
    if pick.lower() == "q" or pick == "0":
    check_missing_3p(None, db_path, WORK_DIR)
    print("Bye.")
    return

    try:
    idx = int(pick) - 1
    if not (0 <= idx < tgt_count):
    raise ValueError
    except ValueError:
    print(f"[ERROR] Invalid selection: '{pick}'")
    input("Press Enter to exit...")
    sys.exit(1)

    target = targets[idx]

    debug(f"SELECTED_LABEL={target.label}")
    debug(f"SQL_WHERE={target.where}")
    debug(f"SQL_ORDER={target.order}")

    run_query(db_path, target, WORK_DIR)

    while True:
    loop_more = yes_no("Export another folder or pane?", default="n")
    if not loop_more:
    break
    # Re-enumerate (in case something changed) and pick again
    targets, tgt_count = enumerate_targets(db_path)
    print()
    pick = prompt(f"Select number [1-{tgt_count}, q to quit]")
    if pick.lower() == "q" or pick == "0":
    break
    try:
    idx = int(pick) - 1
    if not (0 <= idx < tgt_count):
    raise ValueError
    except ValueError:
    print(f"[ERROR] Invalid selection: '{pick}'")
    break
    target = targets[idx]
    run_query(db_path, target, WORK_DIR)

    check_missing_3p(None, db_path, WORK_DIR)
    input("Press Enter to exit...")


    if __name__ == "__main__":
    main()

    # -------------------------------------------------------------------------
    # end of adbfolder.py
    # -------------------------------------------------------------------------
    # Step by step description of what this script does
    # 1. Environment & Configuration Setup
    # A. Command environment
    # a. Disables command echoing and enables delayed expansion
    # b. Sets the working directory to the script's path
    # B. Configuration variables
    # a. Sets default configuration paths for ADB, SQLite
    # and work directories
    # b. Defines the DEBUG toggle flag
    # 2. Dependency Verification
    # A. Executable checks
    # a. Locates adb.exe and checks system PATH or configured fallback path
    # b. Locates sqlite3.exe and exits with an error if missing
    # B. Directory setup
    # a. Creates the local working directory if it does not exist
    # 3. Source Selection Menu
    # A. Choice [1]: Pull from Android via ADB
    # a. Detects connected ADB device target
    # b. Lists .novabackup files in the remote backup directory
    # with fallback search
    # c. Prompts user to select or enter a backup filename/path
    # d. Pulls the selected .novabackup file to the Windows workspace
    # e. Renames the pulled file to backup.zip and extracts it
    # into backup_extracted to retrieve nova.db
    # B. Choice [2]: Use Local Database / Archive
    # a. Prompts user for a custom path to nova.db .novabackup or .zip
    # with a retry loop
    # b. Validates file existence
    # c. Automatically extracts archives if .novabackup or .zip file
    # 4. Database Verification & Target Enumeration
    # A. Database validation
    # a. Verifies that nova.db exists at the target path
    # B. Section 1 [Dock]
    # a. Scans dock apps [container = -101]
    # b. Scans and lists any dock folders
    # C. Section 2 [Panes 0-14]
    # a. Iterates through home screen panes 0 to 14
    # via the scan_pane subroutine
    # b. Queries pane folders [itemType = 2, container = -100]
    # c. Checks for loose non-folder apps [itemType <> 2] on the pane
    # D. Section 3 [Other Folders]
    # a. Searches for orphaned folders not categorized under dock or panes
    # b. Lists and registers valid other folders
    # 5. User Selection & Query Execution [run_query]
    # A. Selection & Sanity
    # a. Prompts user to select a target number or quit [q or 0]
    # b. Sanitizes the selected label using a temporary PowerShell
    # script to generate a safe filename
    # B. Query Generation & Execution
    # a. Writes a dynamic SQLite query script to a temp file
    # [.sql] extracting item ID, app title, package name and raw intent
    # b. Executes the query against nova.db using sqlite3.exe
    # C. Output & Formatting
    # a. Formats output columns [package_name first, display_name second]
    # into an auto-sized table via PowerShell
    # b. Adds a descriptive pane/folder heading and indents the table
    # by two spaces for easier reading and future concatenation
    # c. Saves raw results [output.txt] and formatted results
    # [target_apps.txt] to the work directory
    # d. Appends each formatted export with a timestamp to
    # [adbfolder_log.txt] without overwriting previous exports
    # e. Prompts user to loop back to scan another folder/pane or proceed
    # 6. Optional Unplaced Third-Party Package Check [check_missing_3p]
    # A. Pre-check Validation
    # a. Prompts user whether to check for user-installed packages
    # [-3] missing from the Nova layout
    # b. Verifies ADB device connectivity and database availability
    # c. Optionally prompts user to resolve app labels via adb dumpsys
    # and aapt/aapt2
    # B. Data Collection
    # a. Queries installed third-party packages from device
    # [adb shell pm list packages -3]
    # b. Queries all referenced packages inside nova.db
    # C. Diff Analysis & Cleanup
    # a. Generates and executes a PowerShell diff script to find
    # installed packages with no home screen icon
    # b. Outputs a formatted table of unplaced apps to
    # unplaced_user_apps.txt
    # c. Cleans up temporary script and text files
    # [unless DEBUG=1] and exits cleanly
    # -------------------------------------------------------------------------
    # ------------------------------------------------------------------------- --
    On Usenet are helpful kind-hearted volunteers who know how do to things.
    --- Synchronet 3.22a-Linux NewsLink 1.2
  • From Maria Sophia@mariasophia@comprehension.com to comp.lang.python,alt.os.linux,comp.sys.mac.system,alt.comp.os.windows-11 on Sun Nov 22 02:17:32 2026
    From Newsgroup: alt.comp.os.windows-11

    What's different between the batch and python is mostly:
    a. SQLite queries primarily use Python's built-in sqlite3 module.
    b. Output tables use the third-party tabulate module.
    c. Archive extraction uses Python's zipfile.
    d. Filename sanitization uses Python regular expressions.
    e. There are no generated PowerShell scripts or BAT subroutines.
    f. The optional missing-package check uses Python sets to
    compare installed packages against Nova database packages.
    g. Debugging can be enabled with DEBUG = True or the ADBFOLDER_DEBUG=1
    environment variable.

    As a result of the rewrite, I'm beginning to less-hate python since
    it's actually more intuitive than the Windows batch scripting was. :)

    Here's the new flow in the python script...

    # -------------------------------------------------------------------------
    # Step by step description of what this script does
    # -------------------------------------------------------------------------
    #
    # 1. Environment & Configuration Setup
    # A. Command environment
    # a. Initializes Python execution environment
    # b. Imports required Python modules and dependencies
    # B. Configuration variables
    # a. Sets default configuration paths for ADB, SQLite
    # and work directories
    # b. Defines the DEBUG toggle flag
    # c. Defines temporary and Android backup directories
    #
    # 2. Dependency Verification
    # A. Executable checks
    # a. Locates adb.exe and checks system PATH or configured fallback path
    # b. Locates sqlite3.exe and exits with an error if missing
    # B. Directory setup
    # a. Creates the Nova work directory if it does not exist
    #
    # 3. Source Selection Menu
    # A. Choice [1]: Pull from Android via ADB
    # a. Detects connected ADB device target
    # b. Optionally launches Nova Launcher settings to create a backup
    # c. Lists .novabackup files in the remote backup directory
    # with fallback search of Android storage
    # d. Prompts user to select or enter a backup filename/path
    # e. Pulls the selected .novabackup file to the Windows workspace
    # f. Renames the pulled file to backup.zip and extracts it
    # into backup_extracted to retrieve nova.db
    # B. Choice [2]: Use Local Database / Archive
    # a. Prompts user for a custom path to nova.db, .novabackup or .zip
    # with a retry loop
    # b. Validates file existence
    # c. Automatically extracts archives when necessary
    # d. Optionally offers to restore a .novabackup database to the device
    #
    # 4. Database Verification & Target Enumeration
    # A. Database validation
    # a. Verifies that nova.db exists at the target path
    # B. Section 1 [Dock]
    # a. Scans dock apps [container = -101]
    # b. Scans and lists any dock folders
    # C. Section 2 [Panes 0-14]
    # a. Iterates through home screen panes 0 to 14
    # via the scan_pane function
    # b. Queries pane folders [itemType = 2, container = -100]
    # c. Checks for loose non-folder apps [itemType <> 2] on each pane
    # D. Section 3 [Other Folders]
    # a. Searches for orphaned folders not categorized under dock or panes
    # b. Lists and registers remaining folders
    #
    # 5. User Selection & Query Execution [run_query]
    # A. Selection & Sanity
    # a. Prompts user to select a target number or quit [q or 0]
    # b. Sanitizes the selected label to generate a safe filename
    # B. Query Generation & Execution
    # a. Builds a dynamic SQLite query extracting:
    # - Item ID
    # - Display name
    # - Package name
    # - Raw intent
    # b. Executes the query against nova.db using Python sqlite3
    # c. Falls back to the sqlite3 command-line executable if necessary
    # C. Output & Formatting
    # a. Writes raw tab-delimited results to output.txt
    # b. Formats output columns [package_name first, display_name second]
    # into an aligned table via tabulate
    # c. Adds a descriptive pane/folder heading and indents the table
    # by two spaces for easier reading and future concatenation
    # d. Saves formatted results to [target]_apps.txt
    # e. Appends each formatted export with a timestamp to
    # adbfolder_log.txt without overwriting previous exports
    # f. Displays the formatted results and output file locations
    # D. Repeat Export
    # a. Prompts user to export another folder or pane
    # b. Re-enumerates targets in case the database layout has changed
    # c. Repeats the selection and export process as requested
    #
    # 6. Optional Unplaced Third-Party Package Check [check_missing_3p]
    # A. Pre-check Validation
    # a. Prompts user whether to check for user-installed packages
    # [-3] missing from the Nova layout
    # b. Verifies ADB device connectivity and database availability
    # c. Optionally prompts to resolve app titles via adb/aapt
    # B. Data Collection
    # a. Queries installed third-party packages from device
    # [adb shell pm list packages -3]
    # b. Queries all referenced packages inside nova.db
    # c. Compares installed packages against packages referenced in Nova
    # C. Optional App Title Resolution
    # a. Runs adb shell dumpsys package for each unplaced package
    # b. Searches for nonLocalizedLabel in the package information
    # c. If unavailable, uses adb shell pm path to locate the APK
    # d. Pulls the APK to the PC and uses aapt/aapt2 to read its label
    # D. Diff Analysis & Output
    # a. Identifies installed third-party packages with no Nova icon
    # b. Generates a formatted package_name / app_title table
    # c. Saves results to unplaced_user_apps.txt
    # d. Displays package counts and the resulting unplaced app list
    # E. Cleanup
    # a. Removes temporary package-list files unless DEBUG=1
    # b. Exits cleanly
    #
    # -------------------------------------------------------------------------
    # ------------------------------------------------------------------------- --- Synchronet 3.22a-Linux NewsLink 1.2
  • From Lawrence =?iso-8859-13?q?D=FFOliveiro?=@ldo@nz.invalid to comp.lang.python,alt.os.linux,comp.sys.mac.system,alt.comp.os.windows-11 on Sun Nov 22 07:18:19 2026
    From Newsgroup: alt.comp.os.windows-11

    On Sun, 22 Nov 2026 02:17:32 -0400, Maria Sophia wrote:

    What's different between the batch and python is mostly:
    a. SQLite queries primarily use Python's built-in sqlite3 module.

    I like this alternative <https://rogerbinns.github.io/apsw> to the standard-library sqlite module.

    Pros and cons: <https://rogerbinns.github.io/apsw/pysqlite.html>.

    When doing lots of database queries, I find a function like the
    following very useful for handling the repetitive chores of 1)
    creating a cursor, 2) executing a query on the cursor, 3) fetching the
    results, and 4) disposing of the cursor. APSW version:

    def db_iter(conn, cmd, values = None, mapfn = lambda x : x) :
    "executes cmd on a new cursor from connection conn and yields" \
    " the results in turn."
    for item in conn.cursor().execute(cmd, values) :
    yield mapfn(item)
    #end for
    #end db_iter

    Standard-library sqlite version:

    def db_iter(conn, cmd, values = (), mapfn = lambda x : x) :
    "executes cmd on a new cursor from connection conn and yields" \
    " the results in turn."
    for item in conn.cursor().execute(cmd, values) :
    yield mapfn(item)
    #end for
    #end db_iter

    As a result of the rewrite, I'm beginning to less-hate python since
    it's actually more intuitive than the Windows batch scripting was. :)

    Surely *anything* would be more intuitive than Windows batch scripting
    ...
    --- Synchronet 3.22a-Linux NewsLink 1.2
  • From Maria Sophia@mariasophia@comprehension.com to comp.lang.python,alt.os.linux,comp.sys.mac.system,alt.comp.os.windows-11 on Sun Nov 22 06:02:39 2026
    From Newsgroup: alt.comp.os.windows-11

    Lawrence DoOliveiro wrote:
    On Sun, 22 Nov 2026 02:17:32 -0400, Maria Sophia wrote:

    What's different between the batch and python is mostly:
    a. SQLite queries primarily use Python's built-in sqlite3 module.

    I like this alternative <https://rogerbinns.github.io/apsw> to the standard-library sqlite module.

    Pros and cons: <https://rogerbinns.github.io/apsw/pysqlite.html>.

    When doing lots of database queries, I find a function like the
    following very useful for handling the repetitive chores of 1)
    creating a cursor, 2) executing a query on the cursor, 3) fetching the results, and 4) disposing of the cursor. APSW version:

    def db_iter(conn, cmd, values = None, mapfn = lambda x : x) :
    "executes cmd on a new cursor from connection conn and yields" \
    " the results in turn."
    for item in conn.cursor().execute(cmd, values) :
    yield mapfn(item)
    #end for
    #end db_iter

    Standard-library sqlite version:

    def db_iter(conn, cmd, values = (), mapfn = lambda x : x) :
    "executes cmd on a new cursor from connection conn and yields" \
    " the results in turn."
    for item in conn.cursor().execute(cmd, values) :
    yield mapfn(item)
    #end for
    #end db_iter

    As a result of the rewrite, I'm beginning to less-hate python since
    it's actually more intuitive than the Windows batch scripting was. :)

    Surely *anything* would be more intuitive than Windows batch scripting

    Hi Lawrence,

    There's a lot to unpack there on the "intuition", as you may not know I learned how to code in the 1970's on Fortran IV, IBM Assembly, COBOL, PL/I, etc., where, over time, I evolved to hate coding with a passion because
    every damn language does the same exact thing (more or less), in the end,
    but with frustratingly irrationally different syntax requirements.

    It's kind of like religions. There are so many to choose from, and yet
    they're mostly mutually exclusive, and none of them are based on reality.

    There's merit in picking the one with the loosest set of rules that does
    the job, e.g., pick a religion that allows vice and alcohol to coexist.

    I pick the language with the least restrictive syntax, usually.

    So I tend to "code" in shell scripts, simply because those are the commands
    my fingers use when I need to get something done fast. Yet, the port to
    Python needed vastly fewer crutches than the Windows shell script needed.

    I appreciate your APSW (Another Python SQLite Wrapper) suggestion, and that you shared a generator helper (db_iter) to cut down on repetitive query boilerplate.

    I didn't choose SQL, Nova did, but I can see that APSW might better mirror SQLite's API & behavior, which would be helpful when extending the script. However, it's an external package (pip install apsw) so that increases dependencies, although there might be useful tradeoffs in doing so.

    But I see that instead of writing cur = conn.cursor(), cur.execute(...),
    and cur.fetchall() in every query function, your suggestion allows us to create a cursor, run a cmd with bound values, and yield rows one at a time
    as a generator instead of loading everything into a list up front, where
    mapfn lets us optionally transform each row on the fly to pull a single column.

    I found some minor glitches in the v1p9 code so I fixed them but they
    were minor enough to not need to uprev the version from the last fix.

    #!/usr/bin/env python3
    # ----------------------------------------------------------------------
    # adbfolder.py
    # Usage: python adbfolder.py
    # ----------------------------------------------------------------------
    # Outputs a perfect textual inventory, with debug capability, of an Android
    # homescreen, including location of all panes, folders, packages and titles.
    #
    # Requires adb, sqlite3, tabulate and Nova Launcher (on Android).
    # Optionally requires aapt/aapt2 to determine labels on orphan packages.
    #
    # Intended to assist in debug, inventory, archival, backup and restore.
    # Tested on Windows over Wi-Fi/USB, but should work on macOS/Linux also.
    #
    # Will pull a backup from android via adb or read an existing nova db or
    # nova backup archive on windows needing only adb and sql dependencies
    #
    # List order is top to bottom, left to right, meaning the leftmost pane
    # is 1st, then subsequent panes, from 0 to 1 to 2 and so on to the right.
    #
    # Similarly, the topleft folder is 1st, then the next folder to the right.
    #
    # Likewise, packages and titles inside of folders are listed in top to
    # bottom order, left to right, providing an exact textual description.
    #
    # Bare icons, not inside folders, are listed separately as a line item.
    # The dock and folders in the dock are treated much like the panes are.
    #
    # This script not only provides a textual inventory of the name and
    # homescreen location of every folder name, package name and display
    # name ever added to the homescreen, but it optionally will 'diff'
    # against packages which were manually installed by the user but
    # which have no current homescreen icon (i.e., "headless" apps).
    #
    # Note the display_name is the current icon title for a given app icon,
    # which can be changed by the user, so it's not always the original.
    # However, for apps installed by the user but without homescreen icons,
    # the optional lookup pulls the app's original defined Android app_label.
    #
    # Output is appended to a timestamped running log file for traceability.
    # Unless the user wipes out the running log, this becomes an automatic
    # audit of all the physical changes a user has made to the homescreen.
    # ----------------------------------------------------------------------
    # Q: Why is saying YES to "Resolve app titles via adb/aapt" very slow?
    # A: For each of the unplaced packages, the script does:
    # a. adb shell dumpsys package <pkg> to look for nonLocalizedLabel=
    # b. If that fails: adb shell pm path <pkg> to find the APK location
    # c. adb pull <apk> to download the APK to the PC
    # d. aapt dump badging <apk> to read the app label from the APK
    # Which is up to 4 ADB commands times N apps = 4N round-trips.
    # Over USB, each round-trip is fast (milliseconds).
    # But, over Wi-Fi, each one has wireless handshake latency,
    # so the total time adds up just waiting on ADB to return results.
    # ----------------------------------------------------------------------
    # v1p9 20261122 Replaced redundant which() wrapper with a direct
    # shutil.which import so that which("adb"), which("sqlite3"),
    # which("aapt") and which("aapt2") all work out of the box.
    # v1p8 20261121 Fixed bugs in the optional search for orphan packages
    # v1p7 20261121 Modified the closing comments to reflect the python flow
    # Fixed passing of capture_output=True and text=True twice by
    # mistake in the helper section.
    # v1p6 20261121 Ported to adbfolder.py v1p6 (took a half-dozen iterations)
    # Matched output of abfolder.bat v6p1 with adbfolder.py v1p6
    # v1p0 20261121 First attempt at porting adbfolder.bat to adbfolder.py
    # What's different between the batch and python is mostly:
    # a. SQLite queries primarily use Python's built-in sqlite3 module.
    # b. Output tables use the third-party tabulate module.
    # c. Archive extraction uses Python's zipfile.
    # d. Filename sanitization uses Python regular expressions.
    # e. There are no generated PowerShell scripts or BAT subroutines.
    # f. The optional missing-package check uses Python sets to
    # compare installed packages against Nova database packages.
    # g. Debugging is enabled with DEBUG = True or the ADBFOLDER_DEBUG=1
    # environment variable.
    # ----------------------------------------------------------------------
    # ----------------------------------------------------------------------

    import os
    import sys
    import re
    import subprocess
    import shutil
    import sqlite3
    import zipfile
    import logging
    from shutil import which
    from pathlib import Path
    from datetime import datetime
    from tabulate import tabulate

    # ------------------------------------------------------------------------
    # Configuration
    # ------------------------------------------------------------------------
    DEBUG = False # set True for verbose traces

    ADB_EXE = Path(r"C:\app\editor\android\scrcpy\adb.exe")
    SQLITE_EXE = Path(r"C:\app\editor\android\sdk\platform-tools\sqlite3.exe")
    WORK_DIR = Path(r"C:\app\editor\android\scrcpy\nova")
    ANDROID_BCK_DIR = "/storage/emulated/0/0000/bck/nova_backup"
    DEFAULT_CONTAINER = 2921

    TEMP = Path(os.environ.get("TEMP", Path.home() / "tmp"))


    def debug(msg):
    if DEBUG:
    print(f"[DEBUG] {msg}")


    # ------------------------------------------------------------------------
    # Helpers
    # ------------------------------------------------------------------------
    def run(cmd, **kwargs):
    """Run a command and return CompletedProcess."""
    debug(f"Running: {' '.join(map(str, cmd))}")

    kwargs.setdefault("capture_output", True)
    kwargs.setdefault("text", True)
    kwargs.setdefault("encoding", "utf-8")
    kwargs.setdefault("errors", "replace")
    kwargs.setdefault("timeout", 60)

    return subprocess.run(cmd, **kwargs)

    def ensure_dir(path: Path):
    path.mkdir(parents=True, exist_ok=True)


    def prompt(msg, default=None):
    if default is not None:
    msg = f"{msg} [Default: {default}]: "
    else:
    msg = f"{msg}: "
    val = input(msg).strip()
    return val if val else (default or "")


    def yes_no(msg, default="n"):
    val = prompt(f"{msg} [y/N]" if default != "y" else f"{msg} [Y/n]", default)
    return val.lower().startswith("y")

    # ------------------------------------------------------------------------
    # Dependency check
    # ------------------------------------------------------------------------
    def check_dependencies():
    print("Checking required tools (adb and sqlite3) ...")

    # ADB
    global ADB_EXE
    path_adb = which("adb")
    if not ADB_EXE.exists():
    if path_adb:
    print(f"[INFO] Configured ADB_EXE not found; using PATH: {path_adb}")
    ADB_EXE = Path(path_adb)
    else:
    print(f"[WARN] adb.exe not found at '{ADB_EXE}' and not in PATH.")
    else:
    if not path_adb:
    print(f"[INFO] adb.exe found at configured path, though not in PATH.")

    # SQLite
    global SQLITE_EXE
    path_sqlite = which("sqlite3")
    if not SQLITE_EXE.exists():
    if path_sqlite:
    print(f"[INFO] Configured SQLITE_EXE not found; using PATH: {path_sqlite}")
    SQLITE_EXE = Path(path_sqlite)
    else:
    print(f"[ERROR] sqlite3.exe not found at '{SQLITE_EXE}' and not in PATH.")
    input("Press Enter to exit...")
    sys.exit(1)
    else:
    if not path_sqlite:
    print(f"[INFO] sqlite3.exe found at configured path, though not in PATH.")

    ensure_dir(WORK_DIR)

    print(f"Working directory: {Path.cwd()}")
    print(f"Nova work directory: {WORK_DIR}")
    print("----------------")
    print()


    # ------------------------------------------------------------------------
    # ADB helpers
    # ------------------------------------------------------------------------
    def adb_devices():
    """Return list of connected device serials."""
    res = run([str(ADB_EXE), "devices"])
    devices = []
    for line in res.stdout.strip().splitlines()[1:]:
    parts = line.split()
    if parts and "\t" in line or len(parts) >= 2:
    serial = parts[0]
    state = parts[1] if len(parts) > 1 else ""
    if state == "device":
    devices.append(serial)
    return devices


    def adb_shell(serial, cmd):
    return run([str(ADB_EXE), "-s", serial, "shell", cmd])


    def adb_pull(serial, remote, local):
    return run([str(ADB_EXE), "-s", serial, "pull", remote, str(local)])


    def adb_push(serial, local, remote):
    return run([str(ADB_EXE), "-s", serial, "push", str(local), remote])


    # ------------------------------------------------------------------------
    # Backup pull from Android
    # ------------------------------------------------------------------------
    def pull_from_android():
    print("--- Pull Nova Backup from Android ---")

    if not ADB_EXE.exists():
    print(f"[ERROR] adb.exe not found at: '{ADB_EXE}'")
    input("Press Enter to exit...")
    sys.exit(1)

    devices = adb_devices()
    if not devices:
    print("[ERROR] No connected ADB devices found.")
    input("Press Enter to exit...")
    sys.exit(1)

    serial = devices[0]
    debug(f"ADB_TARGET={serial}")
    print(f"Targeting device: {serial}")

    make_bck = yes_no("Open Nova Launcher settings on device to create a new backup first?")
    if make_bck:
    print("Launching Nova Launcher settings on device ...")
    print("Tap Backup & restore > Backup > Save to save to your device")
    run([
    str(ADB_EXE), "-s", serial, "shell",
    "am", "start",
    "-n",
    "com.teslacoilsw.launcher/com.teslacoilsw.launcher.preferences.SettingsActivity"
    ])
    input("Create your backup in Nova Launcher on the device, then press ENTER to list backups.")

    print(f"Listing backups in {ANDROID_BCK_DIR} ...")
    print()

    # List backups in default dir
    res = adb_shell(serial, f"ls -1t '{ANDROID_BCK_DIR}'/*.novabackup 2>/dev/null")

    backups = parse_adb_lines(res.stdout)

    if not backups:
    print(f"[INFO] No .novabackup files found in {ANDROID_BCK_DIR}.")
    print("Searching Android storage for *.novabackup files ...")
    print()

    search_cmd = (
    "for d in /storage/emulated/0 /storage/*; "
    "do [ -d \"$d\" ] && [ \"$d\" != \"/storage/emulated\" ] && "
    "find \"$d\" -maxdepth 5 -name '*.novabackup' 2>/dev/null; done"
    )
    res = adb_shell(serial, search_cmd)
    backups = parse_adb_lines(res.stdout)

    if not backups:
    print(f"[WARN] No .novabackup files found in {ANDROID_BCK_DIR} or Android storage.")
    remote_bck = manual_backup_path()
    else:
    print()
    for i, (fname, fpath) in enumerate(backups, 1):
    print(f" [{i}] {fname}")
    pick = prompt(f"Select backup number [1-{len(backups)}, Default: 1]", "1")
    try:
    idx = int(pick) - 1
    if not (0 <= idx < len(backups)):
    raise ValueError
    except ValueError:
    # Treat as manual path
    remote_bck = manual_backup_path(pick)
    else:
    fname, fpath = backups[idx]
    remote_bck = fpath

    return download_and_extract(serial, remote_bck)


    def parse_adb_lines(text):
    """Parse ADB output into list of (filename, fullpath)."""
    results = []
    for line in text.splitlines():
    line = line.strip().replace("\r", "")
    if not line:
    continue
    path = Path(line)
    fname = path.name
    results.append((fname, line))
    # Newest first, matching `ls -1t`
    results.sort(key=lambda x: x[0], reverse=True)
    return results

    def manual_backup_path(prefill=""):
    if prefill:
    bck_file = prefill.strip().strip('"')
    else:
    bck_file = prompt(
    "Enter backup filename or full Android path "
    "e.g. 2026-11-19_12-57.novabackup"
    )
    if not bck_file:
    print("[ERROR] No backup filename provided.")
    input("Press Enter to exit...")
    sys.exit(1)

    remote_bck = bck_file
    if not remote_bck.startswith("/"):
    remote_bck = f"{ANDROID_BCK_DIR}/{remote_bck}"
    fname = Path(remote_bck).name
    return remote_bck


    def download_and_extract(serial, remote_bck):
    local_bck = WORK_DIR / Path(remote_bck).name
    local_zip = WORK_DIR / "backup.zip"
    extract_dir = WORK_DIR / "backup_extracted"

    print()
    print(f'Pulling "{remote_bck}" to "{local_bck}" ...')
    res = adb_pull(serial, remote_bck, local_bck)
    if res.returncode != 0:
    print("[ERROR] Failed to pull backup from Android.")
    input("Press Enter to exit...")
    sys.exit(1)

    if local_zip.exists():
    local_zip.unlink()

    # Rename pulled file to backup.zip
    shutil.move(str(local_bck), str(local_zip))

    if extract_dir.exists():
    shutil.rmtree(extract_dir)

    print(f"Extracting backup.zip to '{extract_dir}' ...")
    try:
    with zipfile.ZipFile(local_zip, "r") as zf:
    zf.extractall(extract_dir)
    except Exception as e:
    print(f"[ERROR] Failed to extract backup.zip: {e}")
    input("Press Enter to exit...")
    sys.exit(1)

    db_path = extract_dir / "nova.db"
    return db_path


    # ------------------------------------------------------------------------
    # Local source selection
    # ------------------------------------------------------------------------
    def use_local_source():
    print("--- Local Database Selection ---")
    print(f'Enter the path to nova.db or a .novabackup or .zip file.')
    print(f'Default: {WORK_DIR / "backup_extracted" / "nova.db"}')
    print()

    while True:
    user_db = prompt("Path to database or backup file [Enter for default]")
    if not user_db:
    db_path = WORK_DIR / "backup_extracted" / "nova.db"
    else:
    user_db = user_db.strip().strip('"')
    db_path = Path(user_db).resolve()

    if not db_path.exists():
    print(f"[ERROR] File not found: '{db_path}'")
    retry = prompt("Try again? [Y/n]", "y")
    if retry.lower().startswith("n"):
    sys.exit(1)
    continue

    ext = db_path.suffix.lower()
    if ext == ".novabackup":
    return extract_local_archive(db_path, restore_prompt=True)
    elif ext == ".zip":
    return extract_local_archive(db_path, restore_prompt=False)
    else:
    return db_path


    def extract_local_archive(archive_path, restore_prompt=False):
    extract_dir = WORK_DIR / "backup_extracted"
    if extract_dir.exists():
    shutil.rmtree(extract_dir)

    print(f'Extracting "{archive_path}" to "{extract_dir}" ...')
    try:
    with zipfile.ZipFile(archive_path, "r") as zf:
    zf.extractall(extract_dir)
    except Exception as e:
    print(f"[ERROR] Failed to extract archive: {e}")
    input("Press Enter to exit...")
    sys.exit(1)

    db_path = extract_dir / "nova.db"

    if restore_prompt and yes_no("Restore this backup in Nova on the connected device?"):
    restore_backup_to_device(db_path)

    return db_path


    def restore_backup_to_device(db_path):
    if not ADB_EXE.exists():
    print(f"[ERROR] adb.exe not found at '{ADB_EXE}'; cannot send backup to device.")
    input("Press Enter to exit...")
    sys.exit(1)

    devices = adb_devices()
    if not devices:
    print("[ERROR] No connected ADB device found; cannot restore the backup.")
    input("Press Enter to exit...")
    sys.exit(1)

    serial = devices[0]
    nova_backup_dir = "/storage/emulated/0/Android/data/com.teslacoilsw.launcher/files/Backup"

    print(f'Copying "{db_path}" to Nova backup folder on {serial} ...')
    adb_shell(serial, f"mkdir -p '{nova_backup_dir}'")
    res = adb_push(serial, db_path, nova_backup_dir + "/")
    if res.returncode != 0:
    print("[ERROR] Failed to copy the backup to the device.")
    input("Press Enter to exit...")
    sys.exit(1)

    print(f"Launching Nova Launcher settings on {serial} ...")
    run([
    str(ADB_EXE), "-s", serial, "shell",
    "am", "start",
    "-n",
    "com.teslacoilsw.launcher/com.teslacoilsw.launcher.preferences.SettingsActivity"
    ])
    print("In Nova, choose Backup & restore and restore the backup you copied.")


    # ------------------------------------------------------------------------
    # SQLite helpers (use Python sqlite3 module, fall back to CLI)
    # ------------------------------------------------------------------------
    def sqlite_query(db_path, sql, params=()):
    """Execute a SELECT query using Python sqlite3. Returns list of tuples."""
    try:
    conn = sqlite3.connect(str(db_path))
    cur = conn.execute(sql, params)
    rows = cur.fetchall()
    conn.close()
    return rows
    except sqlite3.Error as e:
    print(f"[ERROR] SQLite query failed: {e}")
    input("Press Enter to exit...")
    sys.exit(1)


    def sqlite_query_cli(db_path, sql, params=()):
    """Fallback: write SQL to temp file and run sqlite3 CLI."""
    sql_file = TEMP / "adbfolder_query.sql"
    sql_file.write_text(sql, encoding="utf-8")
    res = run([str(SQLITE_EXE), str(db_path)], input=sql, text=True)
    if res.returncode != 0:
    print(f"[ERROR] sqlite3 CLI failed: {res.stderr}")
    input("Press Enter to exit...")
    sys.exit(1)
    rows = []
    for line in res.stdout.strip().splitlines():
    rows.append(tuple(line.split("\t")))
    return rows


    # ------------------------------------------------------------------------
    # Target enumeration
    # ------------------------------------------------------------------------
    class Target:
    def __init__(self, num, label, where, order):
    self.num = num
    self.label = label
    self.where = where
    self.order = order


    def enumerate_targets(db_path):
    targets = []
    tgt_count = 0
    listed_folder_ids = set()

    # 1. Dock
    print("dock")
    tgt_count += 1
    targets.append(Target(tgt_count, "dock apps", "f.container = -101",
    "f.screen, f.cellY, f.cellX, f.rank, f._id"))
    print(f" [{tgt_count}] dock apps")

    rows = sqlite_query(db_path,
    "SELECT _id, COALESCE(NULLIF(TRIM(title), ''), '(Untitled Folder)') "
    "FROM favorites WHERE itemType = 2 AND container = -101 "
    "ORDER BY cellY, cellX, rank, _id")
    for fid, fname in rows:
    tgt_count += 1
    label = f"dock - {fname}"
    targets.append(Target(tgt_count, label, f"f.container = {fid}",
    "f.rank, f._id"))
    listed_folder_ids.add(str(fid))
    print(f" [{tgt_count}] {fname}")

    # 2. Panes 0-14
    for pane in range(15):
    tgt_count = scan_pane(db_path, pane, targets, tgt_count, listed_folder_ids)

    # 3. Other folders (orphaned folders not under dock or a pane)
    rows = sqlite_query(db_path,
    "SELECT _id, COALESCE(NULLIF(TRIM(title), ''), '(Untitled Folder)') "
    "FROM favorites WHERE itemType = 2 "
    "ORDER BY LOWER(title), _id")
    other_has_folders = False
    for fid, fname in rows:
    if str(fid) in listed_folder_ids:
    continue
    if not other_has_folders:
    print("other")
    other_has_folders = True
    tgt_count += 1
    label = f"other - {fname}"
    targets.append(Target(tgt_count, label, f"f.container = {fid}",
    "f.rank, f._id"))
    print(f" [{tgt_count}] {fname}")

    return targets, tgt_count


    def scan_pane(db_path, pane, targets, tgt_count, listed_folder_ids):
    rows = sqlite_query(db_path,
    "SELECT _id, COALESCE(NULLIF(TRIM(title), ''), '(Untitled Folder)') "
    "FROM favorites WHERE itemType = 2 AND container = -100 "
    "AND CAST(screen AS INTEGER) = ? "
    "ORDER BY cellY, cellX, rank, _id", (pane,))

    loose_cnt = sqlite_query(db_path,
    "SELECT COUNT(*) FROM favorites WHERE container = -100 "
    "AND CAST(screen AS INTEGER) = ? AND itemType <> 2", (pane,))[0][0]

    has_pane_folders = len(rows) > 0
    print_header = has_pane_folders or loose_cnt > 0

    if print_header:
    print(f"pane {pane}")

    for fid, fname in rows:
    tgt_count += 1
    label = f"pane {pane} - {fname}"
    targets.append(Target(tgt_count, label, f"f.container = {fid}",
    "f.rank, f._id"))
    listed_folder_ids.add(str(fid))
    print(f" [{tgt_count}] {fname}")

    if loose_cnt > 0:
    tgt_count += 1
    label = f"pane {pane} loose apps"
    where = (f"f.container = -100 AND CAST(f.screen AS INTEGER) = {pane} "
    f"AND f.itemType <> 2")
    order = "f.cellY, f.cellX, f.rank, f._id"
    targets.append(Target(tgt_count, label, where, order))
    print(f" [{tgt_count}] pane {pane} loose apps")

    return tgt_count

    # ------------------------------------------------------------------------
    # Sanitize label -> safe filename
    # ------------------------------------------------------------------------
    def sanitize_label(label):
    safe = re.sub(r'[\\/:*?"<>|() ]+', '_', label).strip('_')
    if not safe:
    safe = "nova_target"
    return safe


    # ------------------------------------------------------------------------
    # Run query and format output
    # ------------------------------------------------------------------------
    def run_query(db_path, target, work_dir):
    safe_name = sanitize_label(target.label)
    raw_out = work_dir / "output.txt"
    clean_out = work_dir / f"{safe_name}_apps.txt"
    log_out = work_dir / "adbfolder_log.txt"

    sql = f"""
    SELECT f._id AS item_id,
    f.title AS display_name,
    CASE
    WHEN f.iconPackage IS NOT NULL AND LENGTH(TRIM(f.iconPackage)) > 0
    THEN TRIM(f.iconPackage)
    WHEN INSTR(f.intent, 'component=') > 0 THEN
    CASE
    WHEN INSTR(SUBSTR(f.intent, INSTR(f.intent, 'component=') + 10), '/') > 0
    THEN SUBSTR(SUBSTR(f.intent, INSTR(f.intent, 'component=') + 10),
    1, INSTR(SUBSTR(f.intent, INSTR(f.intent, 'component=') + 10), '/') - 1)
    WHEN INSTR(SUBSTR(f.intent, INSTR(f.intent, 'component=') + 10), ';') > 0
    THEN SUBSTR(SUBSTR(f.intent, INSTR(f.intent, 'component=') + 10),
    1, INSTR(SUBSTR(f.intent, INSTR(f.intent, 'component=') + 10), ';') - 1)
    ELSE SUBSTR(f.intent, INSTR(f.intent, 'component=') + 10)
    END
    WHEN INSTR(f.intent, 'package=') > 0 THEN
    CASE
    WHEN INSTR(SUBSTR(f.intent, INSTR(f.intent, 'package=') + 8), ';') > 0
    THEN SUBSTR(SUBSTR(f.intent, INSTR(f.intent, 'package=') + 8),
    1, INSTR(SUBSTR(f.intent, INSTR(f.intent, 'package=') + 8), ';') - 1)
    ELSE SUBSTR(f.intent, INSTR(f.intent, 'package=') + 8)
    END
    ELSE ''
    END AS package_name,
    f.intent
    FROM favorites f
    WHERE {target.where}
    ORDER BY {target.order};
    """

    print()
    print(f'Querying "{target.label}" ...')

    try:
    rows = sqlite_query(db_path, sql)
    except SystemExit:
    rows = sqlite_query_cli(db_path, sql)

    # Write raw tab-delimited output (all columns)
    with open(raw_out, "w", encoding="utf-8") as f:
    f.write("item_id\tdisplay_name\tpackage_name\tintent\n")
    for row in rows:
    f.write("\t".join(str(c) if c is not None else "" for c in row) + "\n")

    # Format only package_name and display_name, in that order
    display_rows = [(row[2], row[1]) for row in rows] # (package_name, display_name)

    table_text = ""
    if display_rows:
    table_text = tabulate(
    display_rows,
    headers=["package_name", "display_name"],
    tablefmt="plain"
    )

    indented = [" " + line for line in table_text.splitlines()]

    # Header matching batch format
    if target.label.startswith("pane ") and " - " in target.label:
    parts = target.label.split(" - ", 1)
    pane_num = parts[0].replace("pane ", "").strip()
    folder_name = parts[1]
    header = f' pane {pane_num} folder "{folder_name}"'
    else:
    header = f" {target.label}"

    clean_text = header + "\n" + "\n".join(indented) + "\n"

    # Write clean output
    clean_out.write_text(clean_text, encoding="utf-8")

    # Append to running log
    timestamp = datetime.now().strftime("%Y-%m-%d %H:%M:%S")
    entry = (
    "\n============================================================\n"
    f"Export: {timestamp}\n"
    f"{clean_text}"
    )
    with open(log_out, "a", encoding="utf-8") as f:
    f.write(entry)

    print()
    print(f"--- Result ({clean_out}) ---")
    print()
    print(clean_text)
    print(f"Raw tab-delimited output saved to: {raw_out}")
    print(f"Formatted app list saved to: {clean_out}")
    print(f"Running export log saved to: {log_out}")
    print()

    return clean_out

    # ------------------------------------------------------------------------
    # Optional: check missing third-party packages
    # ------------------------------------------------------------------------

    def check_missing_3p(serial, db_path, work_dir):
    print()
    if not yes_no("Check user apps -3 with no icon in Nova before quitting?"):
    return

    if not ADB_EXE.exists():
    print(f"[INFO] adb.exe not found at '{ADB_EXE}'; skipping device package check.")
    return

    devices = adb_devices()
    if not devices:
    print("[INFO] No connected ADB device found; skipping device package check.")
    return

    target_serial = devices[0]
    debug(f"RUN_ADB_TARGET={target_serial}")

    if not db_path or not db_path.exists():
    print("[INFO] Nova database not available; skipping device package check.")
    return

    resolve_labels = yes_no(
    "Resolve app titles via adb/aapt slower over Wi-Fi?",
    default="n"
    )
    do_resolve = resolve_labels

    pm_3p_file = TEMP / "adbfolder_pm3.txt"
    nova_pkgs_file = TEMP / "adbfolder_nova_pkgs.txt"
    unplaced_out = work_dir / "unplaced_user_apps.txt"

    print(f"Querying third-party packages from device {target_serial} ...")
    res = adb_shell(target_serial, "pm list packages -3 2>/dev/null")
    pm_3p_file.write_text(res.stdout, encoding="utf-8")

    installed3 = set()
    for line in pm_3p_file.read_text(encoding="utf-8").splitlines():
    p = line.replace("\r", "").strip()
    if p.startswith("package:"):
    p = p[8:].strip()
    if p:
    installed3.add(p)

    print("Querying packages referenced anywhere in nova.db ...")
    rows = sqlite_query(db_path,
    "SELECT DISTINCT package_name FROM ("
    " SELECT CASE"
    " WHEN iconPackage IS NOT NULL AND LENGTH(TRIM(iconPackage)) > 0"
    " THEN TRIM(iconPackage)"
    " WHEN INSTR(intent, 'component=') > 0 THEN"
    " CASE"
    " WHEN INSTR(SUBSTR(intent, INSTR(intent, 'component=') + 10), '/') > 0"
    " THEN SUBSTR(SUBSTR(intent, INSTR(intent, 'component=') + 10),"
    " 1, INSTR(SUBSTR(intent, INSTR(intent, 'component=') + 10), '/') - 1)"
    " ELSE SUBSTR(intent, INSTR(intent, 'component=') + 10)"
    " END"
    " ELSE ''"
    " END AS package_name"
    " FROM favorites"
    ")"
    "WHERE LENGTH(package_name) > 0")

    in_nova = set()
    for (pkg,) in rows:
    if pkg:
    in_nova.add(pkg)

    missing = sorted(installed3 - in_nova, key=str.lower)

    results = []
    for i, pkg in enumerate(missing, 1):
    label = ""

    if do_resolve:
    if i % 10 == 1 or i == len(missing):
    print(f"Resolving titles: {i}/{len(missing)} ({pkg})...")

    dump = adb_shell(
    target_serial,
    f"dumpsys package {pkg} 2>/dev/null"
    )

    for dl in dump.stdout.splitlines():
    m = re.search(r'nonLocalizedLabel="([^"]+)"', dl)
    if m:
    label = m.group(1).strip()

    if not label:
    # Try aapt path
    # apk_path = shutil.which("aapt") or shutil.which("aapt2")
    apk_path = which("aapt") or which("aapt2")

    if apk_path:
    path_res = adb_shell(
    target_serial,
    f"pm path {pkg} 2>/dev/null"
    )

    for pl in path_res.stdout.splitlines():
    pl = pl.strip()

    if pl.startswith("package:"):
    apk_remote = pl[8:].strip()
    apk_local = TEMP / "adbfolder_probe.apk"

    pull_res = adb_pull(
    target_serial,
    apk_remote,
    apk_local
    )

    if pull_res.returncode == 0 and apk_local.exists():
    badging = run([
    apk_path,
    "dump",
    "badging",
    str(apk_local)
    ])

    if badging.stdout:
    for bl in badging.stdout.splitlines():
    m = re.match(
    r"^application-label:'([^']+)'",
    bl
    )
    if m:
    label = m.group(1).strip()
    break

    if badging.returncode != 0:
    debug(
    f"AAPT failed for {pkg}: {badging.stderr}"
    )

    try:
    apk_local.unlink()
    except Exception:
    pass

    break

    results.append((pkg, label))

    # Write output
    lines = []
    if results:
    lines.append(
    tabulate(
    results,
    headers=["package_name", "app_title"],
    tablefmt="plain"
    ).splitlines()
    )

    flat = []
    for group in lines:
    flat.extend(group)

    table_text = "\n".join(flat) + ("\n" if flat else "")
    unplaced_out.write_text(table_text, encoding="utf-8")

    print()
    print(
    f"User packages (-3): {len(installed3)} | "
    f"In Nova layout: {len(in_nova)} | "
    f"No icon in Nova: {len(missing)}"
    )

    if results:
    print()
    print(table_text.rstrip())

    print(f"Saved unplaced user app list to: {unplaced_out}")
    print()

    # Cleanup temp files unless debug
    if not DEBUG:
    for f in [pm_3p_file, nova_pkgs_file]:
    try:
    f.unlink()
    except Exception:
    pass
    # ------------------------------------------------------------------------
    # Main
    # ------------------------------------------------------------------------
    def main():
    global DEBUG
    # Allow env override
    if os.environ.get("ADBFOLDER_DEBUG", "0") == "1":
    DEBUG = True

    check_dependencies()

    print("Select source for Nova Launcher database:")
    print("[1] Pull .novabackup from Android via ADB and extract nova.db [Default]")
    print("[2] Use an existing nova.db or .novabackup or .zip already on Windows")
    print()

    src_choice = prompt("Enter choice [1 or 2]", "1")

    if src_choice == "2":
    db_path = use_local_source()
    else:
    db_path = pull_from_android()

    if not db_path or not db_path.exists():
    print(f"[ERROR] nova.db not found at: '{db_path}'")
    input("Press Enter to exit...")
    sys.exit(1)

    print()
    print(f"Using database: {db_path}")
    print("Scanning Nova Launcher dock, panes and folders ...")
    print()

    targets, tgt_count = enumerate_targets(db_path)

    print()
    pick = prompt(f"Select number [1-{tgt_count}, q to quit]")
    if pick.lower() == "q" or pick == "0":
    check_missing_3p(None, db_path, WORK_DIR)
    print("Bye.")
    return

    try:
    idx = int(pick) - 1
    if not (0 <= idx < tgt_count):
    raise ValueError
    except ValueError:
    print(f"[ERROR] Invalid selection: '{pick}'")
    input("Press Enter to exit...")
    sys.exit(1)

    target = targets[idx]

    debug(f"SELECTED_LABEL={target.label}")
    debug(f"SQL_WHERE={target.where}")
    debug(f"SQL_ORDER={target.order}")

    run_query(db_path, target, WORK_DIR)

    while True:
    loop_more = yes_no("Export another folder or pane?", default="n")
    if not loop_more:
    break
    # Re-enumerate (in case something changed) and pick again
    targets, tgt_count = enumerate_targets(db_path)
    print()
    pick = prompt(f"Select number [1-{tgt_count}, q to quit]")
    if pick.lower() == "q" or pick == "0":
    break
    try:
    idx = int(pick) - 1
    if not (0 <= idx < tgt_count):
    raise ValueError
    except ValueError:
    print(f"[ERROR] Invalid selection: '{pick}'")
    break
    target = targets[idx]
    run_query(db_path, target, WORK_DIR)

    check_missing_3p(None, db_path, WORK_DIR)
    input("Press Enter to exit...")


    if __name__ == "__main__":
    main()

    # ----------------------------------------------------------------------
    # end of adbfolder.py
    # ----------------------------------------------------------------------
    # ----------------------------------------------------------------------
    # Step by step description of what this script does
    # ----------------------------------------------------------------------
    # 1. Environment & Configuration Setup
    # A. Command environment
    # a. Initializes Python execution environment
    # b. Imports required Python modules and dependencies
    # B. Configuration variables
    # a. Sets default configuration paths for ADB, SQLite
    # and work directories
    # b. Defines the DEBUG toggle flag
    # c. Defines temporary and Android backup directories
    #
    # 2. Dependency Verification
    # A. Executable checks
    # a. Locates adb.exe and checks system PATH
    # or configured fallback path
    # b. Locates sqlite3.exe and exits with an error if missing
    # B. Directory setup
    # a. Creates the Nova work directory if it does not exist
    #
    # 3. Source Selection Menu
    # A. Choice [1]: Pull from Android via ADB
    # a. Detects connected ADB device target
    # b. Optionally launches Nova Launcher settings to create a backup
    # c. Lists .novabackup files in the remote backup directory
    # with fallback search of Android storage
    # d. Prompts user to select or enter a backup filename/path
    # e. Pulls the selected .novabackup file to the Windows workspace
    # f. Renames the pulled file to backup.zip and extracts it
    # into backup_extracted to retrieve nova.db
    # B. Choice [2]: Use Local Database / Archive
    # a. Prompts user for a custom path to nova.db, .novabackup or .zip
    # with a retry loop
    # b. Validates file existence
    # c. Automatically extracts archives when necessary
    # d. Optionally offers to restore a .novabackup database
    # to the device
    #
    # 4. Database Verification & Target Enumeration
    # A. Database validation
    # a. Verifies that nova.db exists at the target path
    # B. Section 1 [Dock]
    # a. Scans dock apps [container = -101]
    # b. Scans and lists any dock folders
    # C. Section 2 [Panes 0-14]
    # a. Iterates through home screen panes 0 to 14
    # via the scan_pane function
    # b. Queries pane folders [itemType = 2, container = -100]
    # c. Checks for loose non-folder apps [itemType <> 2] on each pane
    # D. Section 3 [Other Folders]
    # a. Searches for orphaned folders not categorized under dock
    # or panes
    # b. Lists and registers remaining folders
    #
    # 5. User Selection & Query Execution [run_query]
    # A. Selection & Sanity
    # a. Prompts user to select a target number or quit [q or 0]
    # b. Sanitizes the selected label to generate a safe filename
    # B. Query Generation & Execution
    # a. Builds a dynamic SQLite query extracting:
    # i. Item ID
    # ii. Display name
    # iii. Package name
    # iv. Raw intent
    # b. Executes the query against nova.db using Python sqlite3
    # c. Falls back to the sqlite3 command-line executable if necessary
    # C. Output & Formatting
    # a. Writes raw tab-delimited results to output.txt
    # b. Formats output columns [package_name, display_name]
    # into an aligned table via tabulate
    # c. Adds a descriptive pane/folder heading and indents the table
    # by two spaces for easier reading and future concatenation
    # d. Saves formatted results to [target]_apps.txt
    # e. Appends each formatted export with a timestamp to
    # adbfolder_log.txt without overwriting previous exports
    # f. Displays the formatted results and output file locations
    # D. Repeat Export
    # a. Prompts user to export another folder or pane
    # b. Re-enumerates targets in case the database layout has changed
    # c. Repeats the selection and export process as requested
    #
    # 6. Optional Unplaced Third-Party Package Check [check_missing_3p]
    # A. Pre-check Validation
    # a. Prompts user whether to check for user-installed packages
    # [-3] missing from the Nova layout
    # b. Verifies ADB device connectivity and database availability
    # c. Optionally prompts to resolve app titles via adb/aapt
    # B. Data Collection
    # a. Queries installed third-party packages from device
    # [adb shell pm list packages -3]
    # b. Queries all referenced packages inside nova.db
    # c. Compares installed packages against packages referenced in Nova
    # C. Optional App Title Resolution
    # a. Runs adb shell dumpsys package for each unplaced package
    # b. Searches for nonLocalizedLabel in the package information
    # c. If unavailable, uses adb shell pm path to locate the APK
    # d. Pulls the APK to the PC and uses aapt/aapt2 to read its label
    # D. Diff Analysis & Output
    # a. Identifies installed third-party packages with no Nova icon
    # b. Generates a formatted package_name / app_title table
    # c. Saves results to unplaced_user_apps.txt
    # d. Displays package counts and the resulting unplaced app list
    # E. Cleanup
    # a. Removes temporary package-list files unless DEBUG=1
    # b. Exits cleanly
    # -------------------------------------------------------------------
    # -------------------------------------------------------------------
    --
    Usenet is all about intelligent kind-hearted people helping the team learn.
    --- Synchronet 3.22a-Linux NewsLink 1.2
  • From Lawrence =?iso-8859-13?q?D=FFOliveiro?=@ldo@nz.invalid to comp.lang.python,alt.os.linux,comp.sys.mac.system,alt.comp.os.windows-11 on Sun Nov 22 19:32:30 2026
    From Newsgroup: alt.comp.os.windows-11

    On Sun, 22 Nov 2026 06:02:39 -0400, Maria Sophia wrote:

    There's a lot to unpack there on the "intuition", as you may not
    know I learned how to code in the 1970's on Fortran IV, IBM
    Assembly, COBOL, PL/I, etc., where, over time, I evolved to hate
    coding with a passion because every damn language does the same
    exact thing (more or less), in the end, but with frustratingly
    irrationally different syntax requirements.

    ...

    But I see that instead of writing cur = conn.cursor(),
    cur.execute(...), and cur.fetchall() in every query function, your
    suggestion allows us to create a cursor, run a cmd with bound
    values, and yield rows one at a time as a generator instead of
    loading everything into a list up front, where mapfn lets us
    optionally transform each row on the fly to pull a single column.

    You see why all languages are not the same. The concept of what is rCLhigh-levelrCY has progressed somewhat since the 1970s.
    --- Synchronet 3.22a-Linux NewsLink 1.2