User:Nightjar

Contents

Completed projects

  • Bridge, Frank: Noveletten (parts, from Sibley)
  • Bridge, Frank: Sextet (for strings)
  • Bridge, Frank: Summer
  • Bridge, Frank: Sir Roger de Coverley (string quartet version parts, from Sibley)
  • Chopin, Frederic: Polonaise, Op.53 (autograph manuscript, compiled from the Morgan Library's scan)
  • Cowen, Frederic Hymen: A Daughter of the Sea (from Google's scan)
  • Cowen, Frederic Hymen: The Rose of Life (from Google's scan)
  • Debussy, Claude: Reflets dans l'eau (autograph manuscript, from BNF)
  • Devienne, Francois: Sonata for flute, bassoon and clavecin (from BNF)
  • Devienne, Francois: Sonate en quatuor (flute, horn, viola, cembalo, from BNF)
  • Diabelli, Anton: Exercises, Op.30 (for guitar) (from BSB)
  • Doppler, Franz: Duettino Hongrois (2 flutes, piano, parts from Sibley)
  • Dowland, John arr. Warlock, Peter: 15 lute pieces arranged for piano
  • Dussek, Jan Ladislav: Grand Duo, Op.32e (piano 4 hands, from BNF)
  • Eler, Andre-Frederic: 3 Wind Quartets, Op.6 (from BNF)
  • Elgar, Edward: Serenade (1932)
  • Gaul, Alfred Robert: Israel in the Wilderness (vocal score, from Google's scan)
  • German, Edward: Melody in D flat
  • Gurney, Ivor: Five Preludes
  • Haslinger, Carl: Cello Sonata (compiled from ThULB's scan)
  • Holst, Gustav: Six Choral Folksongs, Op.36
  • Kiel, Friedrich: Piano Trio No.4, Op.33 (compiled from ThULB's scan)
  • Klengel, August Alexander: Piano Trio, Op.36 (compiled from ThULB's scan)
  • Lassen, Eduard: Symphony in D (compiled from ThULB's scan)
  • MacCunn, Hamish: The land of the mountain and the flood
  • MacFarren, George Alexander: King David (vocal score) (from Sibley)
  • Martin, Francois: Inclina Domine (manuscript, from BNF)
  • Mendelssohn, Felix: Clarinet sonata (autograph manuscript, compiled from the Morgan Library's scan)
  • Morales, Cristobel: Missarum Liber I (1544 edition, from BSB)
  • Moscheles, Ignaz: Grand Sextet, Op.35 (compiled from ThULB's scan)
  • Mozart, Wolfgang Amadeus: Piano Concerto in A major, K.488 (converted from BNF's scan)
  • Parry, Hubert: Agamemnon (vocal score) (from Sibley)
  • Parry, Hubert: Blest pair of sirens (vocal score)
  • Parry, Hubert: Eight four-part songs (compiled from Google's scan)
  • Parry, Hubert: Elegy (for organ)
  • Parry, Hubert: Fantasia and Fugue (for organ)
  • Parry, Hubert: Five romantic pieces (for piano)
  • Parry, Hubert: I was glad
  • Parry, Hubert: Invocation to Music (vocal score) (from Sibley)
  • Parry, Hubert: Judith (vocal score) (from Sibley)
  • Parry, Hubert: King Saul (vocal score) (from Sibley)
  • Parry, Hubert: The Love that Casteth out Fear (vocal score, compiled from Google's scan)
  • Parry, Hubert: Prometheus Unbound (vocal score) (from Sibley)
  • Parry, Hubert: A Song of Darkness and Light (vocal score, compiled from Google's scan)
  • Parry, Hubert: Symphony no.5 in B minor (full score)
  • Parry, Hubert: Suite in D major for violin and piano
  • Parry, Hubert: Twelve short pieces for violin and piano (nos. 1 to 4)
  • Pleyel, Ignaz: 3 Duos for 2 flutes (parts, from BNF)
  • Pleyel, Ignaz: Symphonie Concertante in F major (parts, compiled from University of Iowa's scan)
  • Punto, Giovanni: Horn Concerto No.6 (parts, from BNF)
  • Punto, Giovanni: Horn Concerto No.10 (parts, from BNF)
  • Reissiger, Carl Gottlieb: Piano Trio No.1, Op.25 (compiled from ThULB's scan)
  • Rise, Ferdinand: Violin Sonata, Op.10 (compiled from ThULB's scan)
  • Schubert, Franz: Erlkonig (autograph manuscript, compiled from the Morgan Library's scan)
  • Schubert, Franz: Schwanengesang (autograph manuscript, compiled from the Morgan Library's scan)
  • Somervell, Arthur: Christmas (vocal score)
  • Spohr, Louis: Quintet, Op.52 (compiled from ThULB's scan)
  • Spohr, Louis: Septet, Op.147 (compiled from ThULB's scan)
  • Stanford, Charles Villiers: Elegaic Ode (vocal score, from Internet Archive)
  • Stanford, Charles Villiers: Three Motets
  • Thomas, Arthur Goring: The Swan and the Skylark (vocal score, Google scan from Internet Archive)
  • Tulou, Jean-Louis: Marco Spada fantaisie, Op.101 (converted from BNF's scan)
  • Walckiers, Eugene: L'attente, Op.25 (converted from BNF's scan)
  • Warlock, Peter: Adam lay ybounden
  • Warlock, Peter: The Bachelor
  • Warlock, Peter: Benedicamus Domino
  • Warlock, Peter: Corpus Christi (1927 version, score and parts)
  • Warlock, Peter: The Countryman
  • Warlock, Peter: Three Dirges of Webster
  • Warlock, Peter: Hey troly loly lo
  • Warlock, Peter: Jillian of Berry
  • Warlock, Peter: The Jolly Shepherd
  • Warlock, Peter: The Lady's Birthday
  • Warlock, Peter: Lullaby (arr for SSA, piano)
  • Warlock, Peter: Mockery
  • Warlock, Peter: Peterisms (set 1)
  • Warlock, Peter: Piggesnie
  • Warlock, Peter: Serenade
  • Warlock, Peter: Sigh no more, ladies
  • Warlock, Peter: Songs of Summer (Tom Tyler, Elore Lo)
  • Warlock, Peter: Take, O take those lips away
  • Warlock, Peter: There is a Lady Sweet and Kind
  • Warlock, Peter: Twelve Oxen (from Sibley)
  • Warlock, Peter: What cheer? Good cheer!
  • Warlock, Peter: Whenas the Rye reach to the Chin
  • Wesley, Samuel: Voluntaries, op.6 nos.1-6.
  • Wesley, Samuel Sebastian: Ascribe unto the Lord

Pending projects

I have a number of scores which are currently awaiting time to process. If any readers have partiular requests among these, let me know and I may give them a higher priority. In the absence of any convincing (and polite) requests, I'll continue working to my own pace and to my own judgement.

  • Butterworth, George: A Shropshire Lad (complete song cycle)
  • Dowland, John: Lachrimae (transcribed for string quintet by Peter Warlock)
  • German, Edward: The Just So song book (complete song cycle)
  • German, Edward: Songs of Childhood (complete song cycle)
  • Gurney, Ivor: Come, O come, my Life's delight
  • Gurney, Ivor: Ludlow and Teme (complete song cycle, quintet version, score and parts)
  • Gurney, Ivor: Severn Meadows
  • Gurney, Ivor: The Western Playland (complete song cycle, quintet version, score and parts)
  • Holst, Gustav: Egdon Heath (full score, large format, faulty scan pending re-scanning :-()
  • Parry, Hubert: Chorale Preludes (sets 1, 2)
  • Parry, Hubert: Symphony no. 4 (just a request) (see below)
  • Somervell, Arthur: The Passion of Christ (vocal score)
  • Somervell, Arthur: A Shropsire Lad (complete song cycle)
  • Warlock, Peter: Capriol (piano duet version)
  • Warlock, Peter: The Curlew (score and parts)
  • Warlock, Peter: Songs (I have most of Warlock's solo songs in first editions or reprints of first editions. Note that some are still in copyright due to the longevity of some of Warlock's lyricists.)
  • Wesley, Samuel Sebastian: The Wilderness (first edition)

Wishlist

This has been suggested by a visitor to this page. (My own wishlist is long and impractical.)

Parry Symphony No.4

In the many hours I've spent in music libraries, I don't recall ever seeing this work. It appears to be available from the British Library, but acquiring it would incur an inter-library loan fee.

Superceded projects

I still have scans of these on a HDD somewhere, but as they have since been uploaded from other sources I'm unlikely to do any further work on them.

  • Bridge, Frank: Piano Sonata
  • Holst, Gustav: Choral songs from the Rig Veda (vocal score, sets 1, 2, 3)
  • Parry, Hubert: Piano sonata no.2

Scanning stuff

Hardware

I started by scanning scores from my personal collection in my local public library. Their low-budget Canon flatbed scanner performed well enough, so when I decided to buy my own scanner I bought a Canon LiDE 210, also because being USB-powered it would be portable. A downside to this is that the low-power illumination requires pages to be absolutely flat on the glass, so it may not be suitable for fragile or historically valuable documents.

By a happy coincidence, This model also works very well with XSane up to 600dpi, though at 1200dpi several narrow black vertical lines appear in XSane's output.

Software

At various times I've used Scangear (windoze), VueScan (windoze) and XSane (Linux) as scanner front-ends. All these have produced excellent results. For further processing I use ImageMagick and Gimp. In the local public library I used their installation of Photoshop.

Method

My scanning method differs from those suggested elsewhere on this site. I scan all music pages in greyscale, never in monochrome. Firstly, the deskew and resampling functions which I sometimes use give much better results with greyscale images. Secondly, having greyscale files means I can tinker with threshold settings in post-processing, rather than leaving this key part of the process to scanner software which is often horribly inadequate. I only convert pages to monochrome after they're straight and at the final resolution. This method also allows me to set a different threshold level for each page if necessary.

I also find that by using greyscale, scanning at 600dpi gives more than adequate results. I've only once had to resort to 1200dpi scanning, for a particularly unclear miniature score. In my experience, a 600dpi greyscale page is much easier to work with than 1200dpi monochrome: noise is easier to get rid of, and there are fewer ugly jaggies from the resampling process.

Page size

I generally try to recreate in the PDF the (virtual) size of the original, to the nearest millimetre, anyway. This an element of the original document, it doesn't take much extra trouble, and it functions as a kind of checksum on scanning, resampling, and processing. Some digital libraries provide size data; if they don't, I make a guess based on similar documents if any are readily available. Most current PDF printing software can be used to adjust the scaling of the pages to fit your printer.

Reassembling fragmented scans

A number of digital music libraries have adopted a distribution method which rather than making their scans available per-page or per-document, breaks the scans (which are usually of excellent quality) into small tiles which are reassembled in small batches when a user requests a page or part of a page.
For example, the Morgan Library's autograph manuscript of Schubert's Die Winterreise was (at its highest resolution) broken into 15,540 tiles no larger than 256x256px.
A later reassembling project downloaded 20,540 tiles and reassembled them into the pages of the orchestral score of Lassen's Symphony in D, while I was out doing the evening shopping.
The BnF's system is rather friendlier: it allows one to fetch the tiles in sizes up to 2048x2048px, which makes the downloading and reassembling processes much faster. The process was the same in both cases though: download the tiles, giving them filenames with row and column data which could be used by a script calling ImageMagick to reassamble the tiles into pages.

Using ImageMagic to hack music scans

General notes

  • The threshold may need experimenting with. I generally use 50% to 60%, occasionally as low as 40% or as high as 70%.
  • The resize and density values will depend on the input file. The example assumes that the density of the input file is 300dpi.
  • Not all providers of scanned images provide page size data or calibration charts, in which case you may have to guess the original density.
  • If using from a Windoze batch file, replace % with %%. (The Windoze command line conveniently also accepts %% as %.)
  • In my experience, ImageMagick handles multiple commands on a single image very well (see above examples), but handles multiple large images very badly (so badly that I find it safer to use a batch file to process one page at a time).
  • I recently adopted Debian as my primary OS. So far, both ImageMagick and Gimp have been much more stable than they ever were on a well-maintained Windoze XP on the same hardware.

JPG to PDF in one step

Here's an example of how to get from a medium-res JPEG to a reasonable quality mono PDF page in a single step:

convert input.jpg -filter lanczos -resize 200% -threshold 60% -monochrome -units PixelsPerInch -density 600 -compress group4 output.pdf

Creating a blank page

Here's how to create a blank (white) page:

convert -size 6368x8160 canvas:white -density 600 output.png

Changing the canvas size

This is particularly useful for restoring the original size of pages scanned on an under-sized scanner. If the specified geometry is smaller than the input file, the output will be cropped. This example creates a 5338x7040px image with the input file placed in the top left corner.

convert input.tif -background white -extent 5338x7040+0+0 +repage output.png

Alternatively, the gravity command can be used to place the starting image relative to the new canvas. This example places it in the bottom right corner.

convert input.tif -background white -gravity southeast -extent 5338x7040 +repage output.png

Small colour JPG via multiple transforms to acceptable mono PNG

This example is based on a recent real-life score hack in which the pages were 1500px wide and 1900~2000px tall colour JPEGs, with a watermark at the bottom of each page. This command removes the bottom 160 pixels of the input page, resamples the remainder to 3x its size, deskews the page, converts it to monochrome, crops the page to a suitable size, and saves it with a suitable density. After getting poor results with the cubic resampling filter, I tried the other available filters with a representative page sample and found that the catrom filter gave the best results for later conversion to monochrome. (I think that this filter would probably work well with most colour music scans.) In this case, because page size data was not available, I used a page size and density which gave a reasonable estimate of the original size. Saving the files as PNGs enabled me to hand-edit some particularly obtrusive noise from a few pages before converting them to PDFs and collating them.

Note the doubled percentage symbols for use in a Windows batch file. For *n*x shell scripts, you'd use single percentage symbols.

convert input.jpg -gravity south -chop 0x160 -filter catrom -resize 300%% -deskew 40%% -threshold 70%% -extent 4500x5400-100+0 +repage -density 450 output.png

Shell scripting

This bash script takes files with names like ps001.tif, rotates them by 180 degrees if they are odd-numbered, deskews them, crops them to A4 portrait at 600dpi, converts them to monochrome, and saves them with names like pt001.png, while dumping a log of what it does.

 #!/bin/bash
 LOGFILE="pp1.log"
 PAGEFIRST=1
 PAGELAST=32
 PAGEX=4960 # width of final page
 PAGEY=7016 # height of final page
 THRESHOLD="50%"
 PAGE=$PAGEFIRST
 until [ $PAGE -gt $PAGELAST ];do
    remainder=$(( $PAGE % 2 ))
    FILENAMEOLD="ps`printf '%03d' $PAGE`.tif"
    FILENAMENEW="pt`printf '%03d' $PAGE`.png"
    if [ $remainder -eq 0 ]
	then
	# even-numbered page
	COMMAND="convert $FILENAMEOLD -deskew 40% -gravity center -extent ${PAGEX}x${PAGEY} +repage -threshold $THRESHOLD -monochrome $FILENAMENEW"
	else
	# odd-numbered page
	COMMAND="convert $FILENAMEOLD -rotate 180 -deskew 40% -gravity center -extent ${PAGEX}x${PAGEY} +repage -threshold $THRESHOLD -monochrome $FILENAMENEW"
   fi
    echo "$(date +"%Y-%m-%d %H:%M:%S"): $COMMAND"
    echo "$(date +"%Y-%m-%d %H:%M:%S"): $COMMAND" >>$LOGFILE
    #echo $COMMAND
    `$COMMAND`
    let PAGE+=1
done

Essential tools

All of these are free and cross-platform. Many are standard parts of most Linux distros.

  • Gimp for hand-editing of scans.
  • ImageMagick for scripted editing of scans and format conversion. Version 6.7.7 has severe bugs, at least on win32.
  • pdftk for combining PDF pages and adding metadata to them.
  • Emacs for hacking Perl, batch files, shell scripts, keeping notes, and fostering the wonderful illusion of being in control. The Windoze version worked well enough to delay my switch to Debian for several months. This page explains how to get Emacs 24 on Debian Wheezy.
  • Ghostscript I can't remember now why this is on this list.
  • Perl for messy and repetitive jobs (eg fetching multiple pages, generating batch files). A good Windoze port is here.
  • wget for batch downloading files. The Windoze port is here.
  • LibreOffice to keep a giant spreadsheet of the pages I've scanned, and useful data about them.
  • LilyPond for engraving, so far only for music for my own use. It's magnificent.

For some years now I've used PDF-XChange as a PDF viewer and printer for Windoze. It's closed-source, but far better than Adobe's equivalent bloatware, and with more features than the Foxit Reader. It has some very nice options for scaling pages and printing booklets. I've read that it works well under Linux/Wine, but I have yet to try this myself. Evince (Linux) works well for all of the scanned or vector-engraved music I've thrown at it so far.
VueScan is a highly-tweakable scanner front end (cross-platform, closed-source payware with a watermarking trial mode) which can work with a multitude of different scanners as well as RAW files from digital cameras. Folk doing industrial quantities of scanning, or using film scanners or scanners with poor software, should probably check it out.

Afterword

Most of my scanning and processing projects were in abeyance for some time due to ill health. I've recently started uploading stuff again, though this will still be in small quantities.

Lilypond.png
This user uses
GNU LilyPond.
acmp-4 This user is a professional accompanist.
fl-4 This user is a professional flautist.