Latest revision as of 21:24, 8 December 2012

Testing Amarok

This is a TODO-list for testing Amarok before release. It's intended to cover all features and functionalities of Amarok. If something is missing, please add it to list.

Warning: Don't report that last.fm or any service that require to enter your credentials doesn't work if you just haven't added your credentials, you need a user account and activate it in the Amarok Settings -> Configure Amarok ->Plugins section by entering your credentials! Some last.fm services (radio) are only available to paying subscribers.

How to report a bug ? Help Tab --> Report Bug

Important Tests for a release

New Installation

It is very important to test a new installation: this can be done by creating a new user quite easily, as all the configurations are stored individually for each user. (Control Panel-->User Acounts) Note: You need to have administrator privileges to create a new user.

Check if this bug: https://bugs.kde.org/show_bug.cgi?id=284947 is reproducible
Check the sound quality
Create a collection
Grab a pane then move the pane, test if https://bugs.kde.org/show_bug.cgi?id=300753 is a bug for you too.
Check start-up time the first and the subsequent times
Use an external database( Settings Tab--> Configure Amarok --> Database section )

Upgraded Installation

Check existing plugins( Settings Tab--> Configure Amarok --> Plugin section )
Check start-up time the first and the subsequent times
Check existing playlists

Main and Slim Toolbars

Using main toolbar to...
- play or pause playing
- adjust volume
- check artist, album and name of next/previous/current song by hovering
- select a specific time of the current song
- add Position Marker

Using slim toolbar to...
- play, pause or stop playing
- adjust volume
- select a specific time of the current song
- change track by clicking previous/next -buttons
- add Position Marker

Media Sources View

Local Music

Browsing tracks in treeview
Ctrl+F should focus collection search and show local collection even if previously hidden
Searching from collection
Right-click on artist to...
- add it to the playlist.
- replace the playlist.
- edit track details(artist name, genre,score etc)
- organize files(different naming formats, etc.)
Right-click on album to...
- add it to the playlist.
- replace the playlist.
- mass-edit track details(artist name, genre, year, album name)
- organize files(different naming formats, etc.)
- copy to collection
- fetch cover, set cover, display cover, unset cover(for more, check cover manager part of this list),show under various artists
Right-click on track to...
- add it to the playlist.
- replace the playlist.
- edit track details
- organize file(different naming formats, etc.)
- add position marker
Update collection from Tools->Update Collection
Use "Edit filters"
Cover Manager

iPod Collection

Only iPods supported by libgpod are supported by Amarok. Recent models aren't usually supported until reverse-engineered, please always check that you have latest libgpod and the list of supported devices on gtkpod.org site.

iPod collection should show up in Local Music in a few seconds after iPod is plugged in
copy tracks to/from iPod: album cover images should be transfered in both directions, compilation status should survive copying
drag & drop files to Amarok playlist, play them; stop playling
test disconnect behaviour:
- leave some iPod songs in playlist
- disconnect iPod from within Amarok or Plasma Device Notifier
- iPod tracks in playlist should gray-out only when hovered by mouse
- right-click an iPod song → Edit Track Details. It should be visible that the track is no longer editable
- While transferring tracks.
check that songs, compilations and cover images display/play correctly on iPod

Nepomuk Collection

Doesn't work yet.

Other Media Devices Collection

Same tests as for iPods, but in particular:

Check detection of automatic mode in MTP/MSC capable players (doesn't work currently)
Check detection and functionalites of MTP devices
Check detection and functionalites of MSC/USB devices
Check Settings Tab --> Configure Amarok --> Plugin (enable Universal MAss storage collection, it is checked by default )

Remote collections

DAAP
UPnP collection

Internet

Note: All of them need to be enable in the plugin section( Settings Tab--> Configure Amarok --> Plugins)

For last.fm (needs to be enabled first in the plugins):
- check that last.fm sees an already open KDE wallet
- check that scrobbling happens
From Jamendo.com:
- Update database
- Sort/nest tracks, albums and artists with different settings
- Copy/download albums or tracks to collection
- Play similiar artists from Last.fm
- Bookmark items
- Add tracks to playlist
- Replace playlist with a track
- Edit track details->Tags should be grayed out
For Ampache
- add an specific ampache server
For Magnatune Store
- preview stream type
- backup you songs
For MP3 Music Store
- Update database
- Sort/nest tracks, albums and artists with different settings
- Copy/download albums or tracks to collection
- Play similiar artists from Last.fm
- Bookmark items
- Add tracks to playlist
- Replace playlist with a track

Playlists

Drag a song from playlist in any of the open applet see if the menu works.
Ctrl+J should focus playlist search
Save current playlist
Clean playlist
Try the "Random Track/Album" option
Queue track
Arrange playlist ( sound number, source, last played etc )
Undo the last change

Files

Play a song from file

Podcasts

Play a song via Podcast
Add podcast

Menu bar

Amarok-menu

Playing media selected with dialog opened by clicking Open media-item
Changing to previous/next track
Start/stop/pause playing
Stop after current track
Quit ( Close the application safetly )

View-menu

"Lock layout" should be selected by default
Unlocking layout should let Context view, Media Sources and Playlist view to be closed
Changing to Slim toolbar from Main toolbar should be clean.

Playlist-menu

Dynamic Playlists

Repopulate playlist
Clone playlists
Test default biases
Add new biases
Delete Playlist

Saved Playlists

Create an empty playlist
Load playlist from disk or amarok database
Rename playlist
Replace playlist
Delete playlist

Automatic Playlist Generator

Ensure saved presets have all been loaded with all their constraints
Create and delete presets
Run the Generator using each of the presets, and ensure that the Generator returns reasonable results
Test if the program is working after you cancel a running Generator job
Add and remove constraints from a preset
Change settings in each constraint
Save an playlist generated

Tools

Bookmark Manager

Already added bookmarks appear in the Bookmark Manager windows
Adding bookmark of Context View Applets
Adding bookmark of Media Source View
Adding bookmark of Playlist Setup
Adding bookmark of Current Track Position
Does added bookmark loads up cleanly
Bookmarks filtrer

Cover Manager

Searching covers by album name,artist name or keyword + albums with cover/albums with cover
Fetching missing covers button
Displaying cover
Unsetting cover

Settings

Hide Menu Bar ( if you've pressed that by mistake press ctrl+m to unhide the menu bar)
Replay Gain Mode ( off, track, album )

Configure Shortcuts

Amarok default scheme ( tree form )
New/delete scheme
Save as scheme Defaults
Export Scheme
Print scheme

Configure Amarok

General
- Switch between different moodbar styles (Angry, frozen etc.)
- Check if "Automatically scroll playlist to current track" works
- Check if "Automatically retrieve cover art" works
- Check if "Show splash-screen on startup" works
Local Collections
- Add directories to collection and check whether all tracks in the specified directories are added
- Import track informations ( by Itunes, Amarok collection scanner or Amarok 1.4 )
- Use Full rescan button to rescan the specified directories
- Select "Watch folders for changes" and check if it works
Playback
- Change fadeout duration
- Check if "Resume playback on start" works as expected
- Change phonon backend and check if amarok crashes
Notifications
- Test if position of On-Screen-Display works
- Check if "Translucent works"
- Change Duration of On-Screen-Display
- Test if "Don't show when a full screen application is active" works
Database
- Use an external MySql database
Plugins
- Enabling/Disabling plugins
- Configure plugin( credentials,backup etc)
Scripts
- Installing/Uninstalling scripts
- Enabling/Disabling scripts
- Order by ( newest,rating etc )
- Check if "Automatically update built-in scripts" works

Context View

Add/remove applets
Test applet functionalities for
- Info
- Photos
- Spectru-Analyzer
- Albums
- Tabs
- Labels
- Wikipedia
- Upcoming Events
- Current Track
- Lyrics
- Similar Artist
Re-position applets
Change the settings of a specific applet

Playlist View

Drag a song from playlist in any of the open applet see if the menu works.
Ctrl+J should focus playlist search
Save as a playlist to disk
Save as a playlist to collection
Clean playlist
Try the "Random Track/Album" option
Queue track
Arrange playlist ( sound number, source, last played etc )
Undo the last change
Move tracks around changing place