Sysadmin/DeveloperAccessForRuleWriting: Difference between revisions

From KDE Community Wiki
(→‎Announcements: clarify that we still have huey, but not for rule-writing)
(Update documentation to remove louie. Since this leaves us with a single server, I also changed a lot of plurals...)
Line 1: Line 1:
Writing rules for the conversion from SVN to Git requires you to download the whole SVN repository. Its full size is currently 65GB, which is a problem for a lot of our developers. Hence we have setup two servers which can be used for the rule writing (used to be three, but one was decommissioned).
Writing rules for the conversion from SVN to Git requires you to download the whole SVN repository. Its full size is currently 65GB, which is a problem for a lot of our developers. Hence we have setup a server which can be used for the rule writing (used to be three).


The two servers are identical in setup. Every registered KDE developer has access to both servers with the keys you have setup on identity.kde.org.
Every registered KDE developer has access to the server with the keys you have setup on identity.kde.org.


This document assumes you are familiar with the rule writing. A good document to learn more about that can be found at http://techbase.kde.org/Projects/MoveToGit/UsingSvn2Git
This document assumes you are familiar with the rule writing. A good document to learn more about that can be found at http://techbase.kde.org/Projects/MoveToGit/UsingSvn2Git


==Info about the servers==
==Info about the server==
'''dewey.kde.org'''
'''dewey.kde.org'''
   Hexa core, 2GB internal memory
   Hexa core, 2GB internal memory
   Host key fingerprint: 33:6d:9f:cd:b0:4c:36:b9:0f:34:93:30:49:00:ae:88
   Host key fingerprint: 33:6d:9f:cd:b0:4c:36:b9:0f:34:93:30:49:00:ae:88
'''louie.kde.org'''
  Quad core, 512MB internal memory (can be expanded as we need it)
  ssh [email protected] -p22308
  Host key fingerprint: 04:0b:f3:90:ee:06:d3:60:8b:b8:c5:93:61:24:8a:2d


==Remarks==
==Remarks==
*The ssh account name is ''git''. Login with ''ssh git@SERVER.kde.org''
*The ssh account name is ''git''. Login with ''ssh git@dewey.kde.org''
*You share the account with all developers, for example don't install your favorite .vimrc as that affects all developers.
*You share the account with all developers, for example don't install your favorite .vimrc as that affects all developers.
*Don't run any applications because you want to. IRC Bouncers for example.
*Don't run any applications because you want to. IRC Bouncers for example.
*Use it for the rule writing. Everything else is wrong.
*Use it for the rule writing. Everything else is wrong.
*Create a folder named after your identity.kde.org username and only work in there.
*Create a folder named after your identity.kde.org username and only work in there.
*We have made agreements about all this with the donors. If you violate the intended usage, we risk losing the machine.
*We have made agreements about all this with the donor. If you violate the intended usage, we risk losing the machine.


==The setup==
==The setup==
Line 42: Line 37:


==Tip==
==Tip==
''Be aware that "-P 22308" only applied to louie but not the other two servers which use the default ssh port.''


* You can scp your personal folder to your computer with the following command executed from your own computer:
* You can scp your personal folder to your computer with the following command executed from your own computer:
   scp -P 22308 -r git@louie.kde.org:username folder-from-louie
   scp -r git@dewey.kde.org:username folder-from-dewey
  -P 22308 is only needed for louie, otherwise leave it out
   replace 'username' with your svn username (the folder you created on the server)
   replace 'username' with your svn username (the folder you created on the server)
   replace 'folder-from-louie' with folder name you like on your computer.
   replace 'folder-from-dewey' with folder name you like on your computer.


* You can also scp your personal folder from your computer to the server with the following command executed from your own computer:
* You can also scp your personal folder from your computer to the server with the following command executed from your own computer:
   scp -P 22308 -r folder-to-louie git@louie.kde.org:username
   scp -r folder-to-dewey git@dewey.kde.org:username
  -P 22308 is only needed for louie, otherwise leave it out
   replace 'username' with your svn username (the folder you created on the server)
   replace 'username' with your svn username (the folder you created on the server)
   replace 'folder-to-louie' with folder name you have on your computer.
   replace 'folder-to-dewey' with folder name you have on your computer.


==Announcements==
==Announcements==


23 May 2011: huey has been decommissioned from svn2git duties. It's now used for other tasks within KDE.
23 May 2011: huey has been decommissioned from svn2git duties. It's now used for other tasks within KDE.
23 June 2012: louie has been returned to the hoster.

Revision as of 20:07, 22 July 2012

Writing rules for the conversion from SVN to Git requires you to download the whole SVN repository. Its full size is currently 65GB, which is a problem for a lot of our developers. Hence we have setup a server which can be used for the rule writing (used to be three).

Every registered KDE developer has access to the server with the keys you have setup on identity.kde.org.

This document assumes you are familiar with the rule writing. A good document to learn more about that can be found at http://techbase.kde.org/Projects/MoveToGit/UsingSvn2Git

Info about the server

dewey.kde.org

 Hexa core, 2GB internal memory
 ssh [email protected]
 Host key fingerprint: 33:6d:9f:cd:b0:4c:36:b9:0f:34:93:30:49:00:ae:88

Remarks

  • The ssh account name is git. Login with ssh [email protected]
  • You share the account with all developers, for example don't install your favorite .vimrc as that affects all developers.
  • Don't run any applications because you want to. IRC Bouncers for example.
  • Use it for the rule writing. Everything else is wrong.
  • Create a folder named after your identity.kde.org username and only work in there.
  • We have made agreements about all this with the donor. If you violate the intended usage, we risk losing the machine.

The setup

  • svn-all-fast-export is installed into the distro and is from Oct 18th. If a bug is fixed and you need it, drop sysadmin a note and we will start the sequence to update it. Example usage:
 svn-all-fast-export --add-metadata --identity-map /home/gitmaster/kde-ruleset/account-map \
 --rules /home/gitmaster/kde-ruleset/soprano-rules /home/gitmaster/svn/
  • If anything doesn't work and you are unable to figure out how try rerunning the conversion with the "--debug-rules" option.
 svn-all-fast-export --add-metadata --identity-map /home/gitmaster/kde-ruleset/account-map \
 --rules /home/gitmaster/kde-ruleset/soprano-rules --debug-rules /home/gitmaster/svn/

This will print information about what rule matched for each matched file/directory.

  • the svn repo can be queried in the gitmaster home directory. For example:
svn log -v --stop-on-copy file:///home/gitmaster/svn/trunk/extragear/utils/rsibreak 

(please note that there is no physical file on the disk located at /home/gitmaster/svn/trunk/extragear/utils/rsibreak, svn automatically recognizes it is a repository).

  • the svn repo is updated every couple minutes.
  • if you need rules, you can find them in: /home/gitmaster/kde-ruleset, this is read-only, so copy them over to your personal folder and work on them. When done, scp your personal folder to your own computer and commit to git from there.
  • the rules are updated every 4 hours.

Tip

  • You can scp your personal folder to your computer with the following command executed from your own computer:
 scp -r [email protected]:username folder-from-dewey
 replace 'username' with your svn username (the folder you created on the server)
 replace 'folder-from-dewey' with folder name you like on your computer.
  • You can also scp your personal folder from your computer to the server with the following command executed from your own computer:
 scp -r folder-to-dewey [email protected]:username
 replace 'username' with your svn username (the folder you created on the server)
 replace 'folder-to-dewey' with folder name you have on your computer.

Announcements

23 May 2011: huey has been decommissioned from svn2git duties. It's now used for other tasks within KDE. 23 June 2012: louie has been returned to the hoster.