Amarok/Development/Testing/Windows: Difference between revisions

From KDE Community Wiki
(→‎Playlist View: add tags for Amarok 2.6 and Testing)
 
(33 intermediate revisions by one other user not shown)
Line 2: Line 2:
This is a TODO-list for testing Amarok before release. It's intended to cover all features and functionalities of Amarok. If something is missing, please add it to list.  
This is a TODO-list for testing Amarok before release. It's intended to cover all features and functionalities of Amarok. If something is missing, please add it to list.  


Warning: Don't report that last.fm or any service that require to enter your credentials doesn't work if you just haven't added your credentials, you need a user account and activate it in the Amarok Settings -> Configure Amarok ->Plugins section by entering your credentials! Some last.fm services (radio) are only available to paying subscribers.  
'''Warning:''' Don't report that last.fm or any service that require to enter your credentials doesn't work if you just haven't added your credentials, you need a user account and activate it in the Amarok Settings -> Configure Amarok ->Plugins section by entering your credentials! Some last.fm services (radio) are only available to paying subscribers.  


Bugs should be reported [https://bugs.kde.org/enter_bug.cgi?format=guided]
How to report a bug ?
Help Tab --> Report Bug


= Important Tests for a release =
= Important Tests for a release =


== New Installation ==
== New Installation ==
It is very important to test a new installation: this can be done by creating a new user quite easily, as all the configurations are stored individually for each user. (Control Panel-->User Acounts)
'''Note:''' You need to have administrator privileges to create a new user.
* Check if this bug: https://bugs.kde.org/show_bug.cgi?id=284947 is reproducible
* Check the sound quality
* Create a collection
* Grab a pane then  move  the pane, test if https://bugs.kde.org/show_bug.cgi?id=300753 is a bug for you too.
* Check start-up time the first and the subsequent times
* Use an external database( Settings Tab--> Configure Amarok --> Database section )
== Upgraded Installation ==
== Upgraded Installation ==
* Check existing plugins( Settings Tab--> Configure Amarok --> Plugin section )
* Check start-up time the first and the subsequent times
* Check existing playlists
= Main and Slim Toolbars =
= Main and Slim Toolbars =
* Using '''main toolbar''' to...
** play or pause playing
** adjust volume
** check artist, album and name of next/previous/current song by hovering
** select a specific time of the current song
** add Position Marker
* Using '''slim toolbar''' to...
** play, pause or stop playing
** adjust volume
** select a specific time of the current song
** change track by clicking previous/next -buttons
** add Position Marker
= Media Sources View =
= Media Sources View =
== Local Music ==
== Local Music ==
* Browsing tracks in treeview
* Ctrl+F should focus collection search and show local collection even if previously hidden
* Searching from collection
* Right-click on artist to...
** add it to the playlist.
** replace the playlist.
** edit track details(artist name, genre,score etc)
** organize files(different naming formats, etc.)
* Right-click on album to...
** add it to the playlist.
** replace the playlist.
** mass-edit track details(artist name, genre, year, album name)
** organize files(different naming formats, etc.)
** copy to collection
** fetch cover, set cover, display cover, unset cover(for more, check cover manager part of this list),show under various artists
* Right-click on track to...
** add it to the playlist.
** replace the playlist.
** edit track details
** organize file(different naming formats, etc.)
** add position marker
* Update collection from Tools->Update Collection
* Use "Edit filters"
* Cover Manager
=== iPod Collection ===
Only iPods supported by libgpod are supported by Amarok. Recent models aren't usually supported until reverse-engineered, please always check that you have latest libgpod and [http://gtkpod.org/#Status_of_Supported_Hardware the list of supported devices on gtkpod.org site].
* iPod collection should show up in Local Music in a few seconds after iPod is plugged in
* copy tracks to/from iPod: album cover images should be transfered in both directions, compilation status should survive copying
* drag & drop files to Amarok playlist, play them; stop playling
* test disconnect behaviour:
** leave some iPod songs in playlist
** disconnect iPod from within Amarok or Plasma Device Notifier
** iPod tracks in playlist should gray-out  only when hovered by mouse
** right-click an iPod song → Edit Track Details. It should be visible that the track is no longer editable
** While transferring tracks.
* check that songs, compilations and cover images display/play correctly on iPod
=== Nepomuk Collection ===
Doesn't work yet.
=== Other Media Devices Collection ===
Same tests as for iPods, but in particular:
* Check detection of automatic mode in MTP/MSC capable players (doesn't work currently)
* Check detection and functionalites of MTP devices
* Check detection and functionalites of MSC/USB devices
* Check Settings Tab --> Configure Amarok --> Plugin (enable Universal MAss storage collection, it is  checked by default )
=== Remote collections ===
* DAAP
* UPnP collection
== Internet ==
== Internet ==
Note: All of them need to be enable in the plugin section( Settings Tab--> Configure Amarok --> Plugins)
* For last.fm (needs to be enabled first in the plugins):
** check that last.fm sees an already open KDE wallet
** check that scrobbling happens
* From Jamendo.com:
** Update database
** Sort/nest tracks, albums and artists with different settings
** Copy/download albums or tracks to collection
** Play similiar artists from Last.fm
** Bookmark items
** Add tracks to playlist
** Replace playlist with a track
** Edit track details->Tags should be grayed out
* For Ampache
** add an specific ampache server
* For Magnatune Store
** preview stream type
** backup you songs
* For MP3 Music Store
** Update database
** Sort/nest tracks, albums and artists with different settings
** Copy/download albums or tracks to collection
** Play similiar artists from Last.fm
** Bookmark items
** Add tracks to playlist
** Replace playlist with a track
== Playlists ==
== Playlists ==
* Drag a song from playlist in any of the open applet see if the menu works.
* Ctrl+J should focus playlist search
* Save current playlist
* Clean playlist
* Try the "Random Track/Album" option
* Queue track
* Arrange playlist ( sound number, source, last played etc )
* Undo the last change
== Files ==
== Files ==
* Play a song from file
== Podcasts ==
== Podcasts ==
* Play a song via Podcast
* Add podcast
= Menu bar =
== Amarok-menu ==
== Amarok-menu ==
* Playing media selected with dialog opened by clicking Open media-item
* Changing to previous/next track
* Start/stop/pause playing
* Stop after current track
* Quit ( Close the application safetly )
== View-menu ==
== View-menu ==
* "Lock layout" should be selected by default
* Unlocking layout should let Context view, Media Sources and Playlist view to be closed
* Changing to Slim toolbar from Main toolbar should be clean.
== Playlist-menu ==
== Playlist-menu ==
=== Dynamic Playlists ===
* Repopulate playlist
* Clone playlists
* Test default biases
* Add new biases 
* Delete Playlist
=== Saved Playlists ===
* Create an empty playlist
* Load playlist  from disk or amarok database
* Rename playlist
* Replace playlist
* Delete playlist
=== Automatic Playlist Generator ===
* Ensure saved presets have all been loaded with all their constraints
* Create and delete presets
* Run the Generator using each of the presets, and ensure that the Generator returns reasonable results
* Test if the program is working after you cancel a running Generator job 
* Add and remove constraints from a preset
* Change settings in each constraint
* Save an playlist generated
== Tools ==
== Tools ==
=== Bookmark Manager ===
*  Already added bookmarks appear in the Bookmark Manager windows
* Adding bookmark of Context View Applets
* Adding bookmark of Media Source View
* Adding bookmark of Playlist Setup
* Adding bookmark of Current Track Position
* Does added bookmark loads up cleanly
* Bookmarks filtrer
=== Cover Manager ===
* Searching covers by album name,artist name or keyword + albums with cover/albums with cover
* Fetching missing covers button
* Displaying cover
* Unsetting cover
== Settings ==
== Settings ==
*Hide Menu Bar ( if you've pressed that by mistake press ctrl+m to unhide the menu bar)
*Replay Gain Mode ( off, track, album )
=== Configure Shortcuts ===
* Amarok default scheme ( tree form )
* New/delete scheme
* Save as scheme Defaults
* Export Scheme
* Print scheme
=== Configure Amarok ===
* General
** Switch between different moodbar styles (Angry, frozen etc.)
** Check if "Automatically scroll playlist to current track" works
** Check if "Automatically retrieve cover art" works
** Check if "Show splash-screen on startup" works
* Local Collections
** Add directories to collection and check whether all tracks in the specified directories are added
** Import track informations  ( by Itunes, Amarok collection scanner or Amarok 1.4 )
** Use Full rescan button to rescan the specified directories
** Select "Watch folders for changes" and check if it works
* Playback
** Change fadeout duration
** Check if "Resume playback on start" works as expected
** Change phonon backend and check if amarok crashes
* Notifications
** Test if  position of On-Screen-Display works
** Check if "Translucent works"
** Change Duration of On-Screen-Display
** Test if  "Don't show when a full screen application is active" works
* Database
** Use an external MySql database
* Plugins
** Enabling/Disabling plugins
** Configure plugin( credentials,backup etc)
* Scripts
** Installing/Uninstalling scripts
** Enabling/Disabling scripts
** Order by ( newest,rating etc )
** Check if "Automatically update built-in scripts" works
= Context View =
= Context View =
= Nice to test =
* Add/remove applets
== General Layout ==
* Test applet functionalities for
== Equalizer ==
** Info
Doesn't work.
** Photos
== Network Request Viewer ==
** Spectru-Analyzer
** Albums
** Tabs
** Labels
** Wikipedia
** Upcoming Events
** Current Track
** Lyrics
** Similar Artist
* Re-position applets
* Change the settings of a specific applet
 
= Playlist View =
* Drag a song from playlist in any of the open applet see if the menu works.
* Ctrl+J should focus playlist search
* Save as a playlist to disk
* Save as a playlist to collection
* Clean playlist
* Try the "Random Track/Album" option
* Queue track
* Arrange playlist ( sound number, source, last played etc )
* Undo the last change
* Move tracks around changing place
 
[[Category:Amarok2.6]]
[[Category:Testing]]

Latest revision as of 21:24, 8 December 2012

Testing Amarok

This is a TODO-list for testing Amarok before release. It's intended to cover all features and functionalities of Amarok. If something is missing, please add it to list.

Warning: Don't report that last.fm or any service that require to enter your credentials doesn't work if you just haven't added your credentials, you need a user account and activate it in the Amarok Settings -> Configure Amarok ->Plugins section by entering your credentials! Some last.fm services (radio) are only available to paying subscribers.

How to report a bug ? Help Tab --> Report Bug

Important Tests for a release

New Installation

It is very important to test a new installation: this can be done by creating a new user quite easily, as all the configurations are stored individually for each user. (Control Panel-->User Acounts) Note: You need to have administrator privileges to create a new user.

Upgraded Installation

  • Check existing plugins( Settings Tab--> Configure Amarok --> Plugin section )
  • Check start-up time the first and the subsequent times
  • Check existing playlists

Main and Slim Toolbars

  • Using main toolbar to...
    • play or pause playing
    • adjust volume
    • check artist, album and name of next/previous/current song by hovering
    • select a specific time of the current song
    • add Position Marker
  • Using slim toolbar to...
    • play, pause or stop playing
    • adjust volume
    • select a specific time of the current song
    • change track by clicking previous/next -buttons
    • add Position Marker

Media Sources View

Local Music

  • Browsing tracks in treeview
  • Ctrl+F should focus collection search and show local collection even if previously hidden
  • Searching from collection
  • Right-click on artist to...
    • add it to the playlist.
    • replace the playlist.
    • edit track details(artist name, genre,score etc)
    • organize files(different naming formats, etc.)
  • Right-click on album to...
    • add it to the playlist.
    • replace the playlist.
    • mass-edit track details(artist name, genre, year, album name)
    • organize files(different naming formats, etc.)
    • copy to collection
    • fetch cover, set cover, display cover, unset cover(for more, check cover manager part of this list),show under various artists
  • Right-click on track to...
    • add it to the playlist.
    • replace the playlist.
    • edit track details
    • organize file(different naming formats, etc.)
    • add position marker
  • Update collection from Tools->Update Collection
  • Use "Edit filters"
  • Cover Manager


iPod Collection

Only iPods supported by libgpod are supported by Amarok. Recent models aren't usually supported until reverse-engineered, please always check that you have latest libgpod and the list of supported devices on gtkpod.org site.

  • iPod collection should show up in Local Music in a few seconds after iPod is plugged in
  • copy tracks to/from iPod: album cover images should be transfered in both directions, compilation status should survive copying
  • drag & drop files to Amarok playlist, play them; stop playling
  • test disconnect behaviour:
    • leave some iPod songs in playlist
    • disconnect iPod from within Amarok or Plasma Device Notifier
    • iPod tracks in playlist should gray-out only when hovered by mouse
    • right-click an iPod song → Edit Track Details. It should be visible that the track is no longer editable
    • While transferring tracks.
  • check that songs, compilations and cover images display/play correctly on iPod

Nepomuk Collection

Doesn't work yet.

Other Media Devices Collection

Same tests as for iPods, but in particular:

  • Check detection of automatic mode in MTP/MSC capable players (doesn't work currently)
  • Check detection and functionalites of MTP devices
  • Check detection and functionalites of MSC/USB devices
  • Check Settings Tab --> Configure Amarok --> Plugin (enable Universal MAss storage collection, it is checked by default )

Remote collections

  • DAAP
  • UPnP collection

Internet

Note: All of them need to be enable in the plugin section( Settings Tab--> Configure Amarok --> Plugins)

  • For last.fm (needs to be enabled first in the plugins):
    • check that last.fm sees an already open KDE wallet
    • check that scrobbling happens
  • From Jamendo.com:
    • Update database
    • Sort/nest tracks, albums and artists with different settings
    • Copy/download albums or tracks to collection
    • Play similiar artists from Last.fm
    • Bookmark items
    • Add tracks to playlist
    • Replace playlist with a track
    • Edit track details->Tags should be grayed out
  • For Ampache
    • add an specific ampache server
  • For Magnatune Store
    • preview stream type
    • backup you songs
  • For MP3 Music Store
    • Update database
    • Sort/nest tracks, albums and artists with different settings
    • Copy/download albums or tracks to collection
    • Play similiar artists from Last.fm
    • Bookmark items
    • Add tracks to playlist
    • Replace playlist with a track

Playlists

  • Drag a song from playlist in any of the open applet see if the menu works.
  • Ctrl+J should focus playlist search
  • Save current playlist
  • Clean playlist
  • Try the "Random Track/Album" option
  • Queue track
  • Arrange playlist ( sound number, source, last played etc )
  • Undo the last change

Files

  • Play a song from file

Podcasts

  • Play a song via Podcast
  • Add podcast

Menu bar

Amarok-menu

  • Playing media selected with dialog opened by clicking Open media-item
  • Changing to previous/next track
  • Start/stop/pause playing
  • Stop after current track
  • Quit ( Close the application safetly )

View-menu

  • "Lock layout" should be selected by default
  • Unlocking layout should let Context view, Media Sources and Playlist view to be closed
  • Changing to Slim toolbar from Main toolbar should be clean.

Playlist-menu

Dynamic Playlists

  • Repopulate playlist
  • Clone playlists
  • Test default biases
  • Add new biases
  • Delete Playlist

Saved Playlists

  • Create an empty playlist
  • Load playlist from disk or amarok database
  • Rename playlist
  • Replace playlist
  • Delete playlist

Automatic Playlist Generator

  • Ensure saved presets have all been loaded with all their constraints
  • Create and delete presets
  • Run the Generator using each of the presets, and ensure that the Generator returns reasonable results
  • Test if the program is working after you cancel a running Generator job
  • Add and remove constraints from a preset
  • Change settings in each constraint
  • Save an playlist generated

Tools

Bookmark Manager

  • Already added bookmarks appear in the Bookmark Manager windows
  • Adding bookmark of Context View Applets
  • Adding bookmark of Media Source View
  • Adding bookmark of Playlist Setup
  • Adding bookmark of Current Track Position
  • Does added bookmark loads up cleanly
  • Bookmarks filtrer


Cover Manager

  • Searching covers by album name,artist name or keyword + albums with cover/albums with cover
  • Fetching missing covers button
  • Displaying cover
  • Unsetting cover

Settings

  • Hide Menu Bar ( if you've pressed that by mistake press ctrl+m to unhide the menu bar)
  • Replay Gain Mode ( off, track, album )

Configure Shortcuts

  • Amarok default scheme ( tree form )
  • New/delete scheme
  • Save as scheme Defaults
  • Export Scheme
  • Print scheme

Configure Amarok

  • General
    • Switch between different moodbar styles (Angry, frozen etc.)
    • Check if "Automatically scroll playlist to current track" works
    • Check if "Automatically retrieve cover art" works
    • Check if "Show splash-screen on startup" works
  • Local Collections
    • Add directories to collection and check whether all tracks in the specified directories are added
    • Import track informations ( by Itunes, Amarok collection scanner or Amarok 1.4 )
    • Use Full rescan button to rescan the specified directories
    • Select "Watch folders for changes" and check if it works
  • Playback
    • Change fadeout duration
    • Check if "Resume playback on start" works as expected
    • Change phonon backend and check if amarok crashes
  • Notifications
    • Test if position of On-Screen-Display works
    • Check if "Translucent works"
    • Change Duration of On-Screen-Display
    • Test if "Don't show when a full screen application is active" works
  • Database
    • Use an external MySql database
  • Plugins
    • Enabling/Disabling plugins
    • Configure plugin( credentials,backup etc)
  • Scripts
    • Installing/Uninstalling scripts
    • Enabling/Disabling scripts
    • Order by ( newest,rating etc )
    • Check if "Automatically update built-in scripts" works

Context View

  • Add/remove applets
  • Test applet functionalities for
    • Info
    • Photos
    • Spectru-Analyzer
    • Albums
    • Tabs
    • Labels
    • Wikipedia
    • Upcoming Events
    • Current Track
    • Lyrics
    • Similar Artist
  • Re-position applets
  • Change the settings of a specific applet

Playlist View

  • Drag a song from playlist in any of the open applet see if the menu works.
  • Ctrl+J should focus playlist search
  • Save as a playlist to disk
  • Save as a playlist to collection
  • Clean playlist
  • Try the "Random Track/Album" option
  • Queue track
  • Arrange playlist ( sound number, source, last played etc )
  • Undo the last change
  • Move tracks around changing place