Amarok/Development/Testing/Windows

From KDE Community Wiki

Testing Amarok

This is a TODO-list for testing Amarok before release. It's intended to cover all features and functionalities of Amarok. If something is missing, please add it to list.

Warning: Don't report that last.fm or any service that require to enter your credentials doesn't work if you just haven't added your credentials, you need a user account and activate it in the Amarok Settings -> Configure Amarok ->Plugins section by entering your credentials! Some last.fm services (radio) are only available to paying subscribers.

How to report a bug ? Help Tab --> Report Bug

Important Tests for a release

New Installation

It is very important to test a new installation: this can be done by creating a new user quite easily, as all the configurations are stored individually for each user. (Control Panel-->User Acounts) Note: You need to have administrator privileges to create a new user.

Upgraded Installation

  • Check existing plugins( Settings Tab--> Configure Amarok --> Plugin section )
  • Check start-up time the first and the subsequent times
  • Check existing playlists

Main and Slim Toolbars

  • Using main toolbar to...
    • play or pause playing
    • adjust volume
    • check artist, album and name of next/previous/current song by hovering
    • select a specific time of the current song
    • add Position Marker
  • Using slim toolbar to...
    • play, pause or stop playing
    • adjust volume
    • select a specific time of the current song
    • change track by clicking previous/next -buttons
    • add Position Marker

Media Sources View

Local Music

  • Browsing tracks in treeview
  • Ctrl+F should focus collection search and show local collection even if previously hidden
  • Searching from collection
  • Right-click on artist to...
    • add it to the playlist.
    • replace the playlist.
    • edit track details(artist name, genre,score etc)
    • organize files(different naming formats, etc.)
  • Right-click on album to...
    • add it to the playlist.
    • replace the playlist.
    • mass-edit track details(artist name, genre, year, album name)
    • organize files(different naming formats, etc.)
    • copy to collection
    • fetch cover, set cover, display cover, unset cover(for more, check cover manager part of this list),show under various artists
  • Right-click on track to...
    • add it to the playlist.
    • replace the playlist.
    • edit track details
    • organize file(different naming formats, etc.)
    • add position marker
  • Update collection from Tools->Update Collection
  • Use "Edit filters"
  • Cover Manager


iPod Collection

Only iPods supported by libgpod are supported by Amarok. Recent models aren't usually supported until reverse-engineered, please always check that you have latest libgpod and the list of supported devices on gtkpod.org site.

  • iPod collection should show up in Local Music in a few seconds after iPod is plugged in
  • copy tracks to/from iPod: album cover images should be transfered in both directions, compilation status should survive copying
  • drag & drop files to Amarok playlist, play them; stop playling
  • test disconnect behaviour:
    • leave some iPod songs in playlist
    • disconnect iPod from within Amarok or Plasma Device Notifier
    • iPod tracks in playlist should gray-out only when hovered by mouse
    • right-click an iPod song → Edit Track Details. It should be visible that the track is no longer editable
    • While transferring tracks.
  • check that songs, compilations and cover images display/play correctly on iPod

Nepomuk Collection

Doesn't work yet.

Other Media Devices Collection

Same tests as for iPods, but in particular:

  • Check detection of automatic mode in MTP/MSC capable players (doesn't work currently)
  • Check detection and functionalites of MTP devices
  • Check detection and functionalites of MSC/USB devices
  • Check Settings Tab --> Configure Amarok --> Plugin (enable Universal MAss storage collection, it is checked by default )

Remote collections

  • DAAP
  • UPnP collection

Internet

Note: All of them need to be enable in the plugin section( Settings Tab--> Configure Amarok --> Plugins)

  • For last.fm (needs to be enabled first in the plugins):
    • check that last.fm sees an already open KDE wallet
    • check that scrobbling happens
  • From Jamendo.com:
    • Update database
    • Sort/nest tracks, albums and artists with different settings
    • Copy/download albums or tracks to collection
    • Play similiar artists from Last.fm
    • Bookmark items
    • Add tracks to playlist
    • Replace playlist with a track
    • Edit track details->Tags should be grayed out
  • For Ampache
    • add an specific ampache server
  • For Magnatune Store
    • preview stream type
    • backup you songs
  • For MP3 Music Store
    • Update database
    • Sort/nest tracks, albums and artists with different settings
    • Copy/download albums or tracks to collection
    • Play similiar artists from Last.fm
    • Bookmark items
    • Add tracks to playlist
    • Replace playlist with a track

Playlists

  • Drag a song from playlist in any of the open applet see if the menu works.
  • Ctrl+J should focus playlist search
  • Save current playlist
  • Clean playlist
  • Try the "Random Track/Album" option
  • Queue track
  • Arrange playlist ( sound number, source, last played etc )
  • Undo the last change

Files

  • Play a song from file

Podcasts

  • Play a song via Podcast
  • Add podcast

Menu bar

Amarok-menu

  • Playing media selected with dialog opened by clicking Open media-item
  • Changing to previous/next track
  • Start/stop/pause playing
  • Stop after current track
  • Quit ( Close the application safetly )

View-menu

  • "Lock layout" should be selected by default
  • Unlocking layout should let Context view, Media Sources and Playlist view to be closed
  • Changing to Slim toolbar from Main toolbar should be clean.

Playlist-menu

Dynamic Playlists

  • Repopulate playlist
  • Clone playlists
  • Test default biases
  • Add new biases
  • Delete Playlist

Saved Playlists

  • Create an empty playlist
  • Load playlist from disk or amarok database
  • Rename playlist
  • Replace playlist
  • Delete playlist

Automatic Playlist Generator

  • Ensure saved presets have all been loaded with all their constraints
  • Create and delete presets
  • Run the Generator using each of the presets, and ensure that the Generator returns reasonable results
  • Test if the program is working after you cancel a running Generator job
  • Add and remove constraints from a preset
  • Change settings in each constraint
  • Save an playlist generated

Tools

Bookmark Manager

  • Already added bookmarks appear in the Bookmark Manager windows
  • Adding bookmark of Context View Applets
  • Adding bookmark of Media Source View
  • Adding bookmark of Playlist Setup
  • Adding bookmark of Current Track Position
  • Does added bookmark loads up cleanly
  • Bookmarks filtrer


Cover Manager

  • Searching covers by album name,artist name or keyword + albums with cover/albums with cover
  • Fetching missing covers button
  • Displaying cover
  • Unsetting cover

Settings

  • Hide Menu Bar ( if you've pressed that by mistake press ctrl+m to unhide the menu bar)
  • Replay Gain Mode ( off, track, album )

Configure Shortcuts

  • Amarok default scheme ( tree form )
  • New/delete scheme
  • Save as scheme Defaults
  • Export Scheme
  • Print scheme

Configure Amarok

  • General
    • Switch between different moodbar styles (Angry, frozen etc.)
    • Check if "Automatically scroll playlist to current track" works
    • Check if "Automatically retrieve cover art" works
    • Check if "Show splash-screen on startup" works
  • Local Collections
    • Add directories to collection and check whether all tracks in the specified directories are added
    • Import track informations ( by Itunes, Amarok collection scanner or Amarok 1.4 )
    • Use Full rescan button to rescan the specified directories
    • Select "Watch folders for changes" and check if it works
  • Playback
    • Change fadeout duration
    • Check if "Resume playback on start" works as expected
    • Change phonon backend and check if amarok crashes
  • Notifications
    • Test if position of On-Screen-Display works
    • Check if "Translucent works"
    • Change Duration of On-Screen-Display
    • Test if "Don't show when a full screen application is active" works
  • Database
    • Use an external MySql database
  • Plugins
    • Enabling/Disabling plugins
    • Configure plugin( credentials,backup etc)
  • Scripts
    • Installing/Uninstalling scripts
    • Enabling/Disabling scripts
    • Order by ( newest,rating etc )
    • Check if "Automatically update built-in scripts" works

Context View

  • Add/remove applets
  • Test applet functionalities for
    • Info
    • Photos
    • Spectru-Analyzer
    • Albums
    • Tabs
    • Labels
    • Wikipedia
    • Upcoming Events
    • Current Track
    • Lyrics
    • Similar Artist
  • Re-position applets
  • Change the settings of a specific applet

Playlist View

  • Drag a song from playlist in any of the open applet see if the menu works.
  • Ctrl+J should focus playlist search
  • Save as a playlist to disk
  • Save as a playlist to collection
  • Clean playlist
  • Try the "Random Track/Album" option
  • Queue track
  • Arrange playlist ( sound number, source, last played etc )
  • Undo the last change
  • Move tracks around changing place