SCM

• SCM History
  • Aug 7, 2014
• SCM BACKUP
  • FUNCTIONS
  • STATE OF LOCK ADDITIONS
  • ABOUT LOCKING : GLOBAL AND RSYNC LOCKS
  • INTEGRITY CHECKS
  • DURING AN RSYNC TRANSFER, BOTH SIZE AND DIGEST DIFFER
  • ISSUE : rsync not woking, tarballs not getting purged ?
  • ISSUE : fabric run fails
  • ISSUES WITH NEW INTEGRITY TESTS
  • IHEP CRON RUNNING OF THE BACKUPS
  • POTENTIAL scm-backup-repo ISSUE AT 2GB
  • HOW TO RECOVER dayabay TARBALLS ONTO cms02, run from C2 (sudo is used)
  • HOW TO TEST SOME IMPROVED ERROR CHECKING WITH SINGLE REPO/TRAC BACKUPS
  • TESTING FULL BACKUP INTO TMP DIRECTORY
  • SLIMMING THE TRAC TGZ ... ALL THOSE BITTEN LOGS
  • Common issues
    • backups stopped
    • backups done but not synced off box
  • TODO
• Notes
  • C2 backups sent to C
    • datetime.fromtimestamp returns local
    • sqlite not offsetting
• Monitor
  • HKU (hub HKU)
    • D8R : dayabay8core
  • IHEP (hub ZZ)
    • SDU : Shandong University Backup
  • Setup
  • How the plotting work
  • Configuring the monitoring
  • Manual Testing
  • Automation
  • Improvement Ideas
• Dev notes
  • Deficiencies
  • Deploying to dayabay.ihep.ac.cn ?
  • automated updating
  • highstock and highcharts interference ?
  • Todo
  • highstock with jsfiddle
  • nginx config
  • serverside highcharts/highstock with nodejs
• SVN2GIT via git svn clone
  • FUNCTIONS
  • issues
    • slow
    • all users with any repo activity must be defined
• Altbackup
  • Alternative Simple Backup using scp rather than rsync
    • Timings and cron invokation
    • Issues
      • truncated transfer due to connection timeout
      • slow transfer leading to monitor warning
      • monitor warnings from no dna
  • Bash Wrapper altbackup.sh
• bash wrapper for altbackup.py
  • Crontab examples
  • SSH Debugging
  • Current Observed Timings, May 2013
  • Notification
• Bitten Querying
  • altquery.py for trac.db querying
    • python version
    • sub-commands
      • last_by_slave
      • step_times_byrev
• bitbucket
  • Migration
    • git or mercurial
    • observations on github vs bitbucket
    • meshlab into bitbucket
    • Bitbucket Readme
    • Check cloning
    • Git Remotes
      • Do I always need to git push -u origin master ?
  • Trac Tickets to Bitbucket zip
    • Bitbucket issue ZIP import
    • trac2bb
    • trac2bitbucket
  • Bitbucket Features
    • Publishing Pages
    • Valid Hostnames
    • Tarball Distribution ?
  • Bitbucket SSH
    • https/http clones from bitbucket are hanging
      • was not patient enough
      • after several minutes it succeeds
    • Try setting up SSH
    • follow along SSH setup
      • Step 5. Enable SSH compression for Mercurial
      • Step 6. Install the public key on your Bitbucket account
      • try a clone via ssh
      • Compare clones
      • Step 7. Change your repo from HTTPS to the SSH protocol
      • Check SSH setup
  • Bitbucket Env
• github
  • Github
  • Github Features
• SourceForge
• SCM Hosting Services
• Binary releases