Co-taught with Victor Prisacariu
Congratulations to team SOS
Technology is emerging that makes it possible to fix, section, and scan brain tissue at very high resolution – high enough to resolve even synaptic strengths. This brings whole new meaning to the idea of saving oneself. See The Brain Preservation Foundation for additional clarification and inspiration.
Your task will be to design hardware, a facility, and set of computational processes that make it possible to scan, process (extracting neuronal connections and strength), upload, and save an entire human brain for possible future reanimation for amortized cost within reach of the world’s financial elite. Design elements can realistically be expected to include high-volume electron or other microscopes, precision cutters, software infrastructure, computing infrastructure, process optimisations, and archival mechanisms. Your work should emphasize the design of software and algorithms for classification of required tissue subtypes and image processing in general. What is more, you will be expected to implement such software and run it on an advanced high performance cluster.
The human brain is a phenomenally complex organ with meaningful structure requiring nanometer-resolution scans to even possibly be able to reanimate in the future. Besides the challenges of sourcing or building microscopes capable of processing the required volume, designing automation machinery, processes, and the like; naive data capture would require staggering amounts of storage. As a result powerful machine learning systems and processes also will need to be designed. Implementation for some of these algorithms is expected and a workflow for those that are not provided.
Beyond the usual 3YP organization involving log books, group work, presentations, and writing, we expect several of the leading researchers in this area to be able to join us either in person or via video conference to answer questions. Students will also be required to implement and develop their own algorithmic solutions to problems pertinent to the overall design brief using existing data.
All groups will work together through Michaelmas on the overall facility, recording, cutting, chemical, and data processing design. The first half of Michaelmas will be dedicated to the design of hardware for data acquisition. The later part of Michaelmas will serve as an introduction to the data considerations and the interplay between hardware, software, and data considerations. Hilary will be dedicated to computational and software architecture design for the data processing pipeline, with a competition to he held between groups on one particular data processing aspect which we expect you will come to find essential.
To get started MATLAB infrastructure will be provided, as too access to a cluster, but you are free to use other languages and software packages.
Version control for collaboration
You must use git via bitbucket
for version control of your reports, software, and presentations. Each group must create a
repository and add “fwood” and “victorprad” as collaborators with appropriate permissions. You may wish to
read online resources like this blog
and this tutorial
to help acquaint yourself with this essential technology. And remember, practice makes perfect.
In addition to other metrics for judging relative contributions, your git behaviour will be
tracked. Also, version control systems, in addition
to writing in laboratory notebooks, can help to establish IP precedence.
LaTeX for writing
You must use latex and bibtex to write your final report and the report must be versioned in the aforementioned git repository. You may wish to read online resources like this blog to get started.
Beamer for presentations
You must use [beamer](http://en.wikipedia.org/wiki/Beamer_(LaTeX) for presentations (i.e. not powerpoint, keynote, etc.). All presentations must be version controlled as well. The beamer source file for the introductory lecture to this course is a reasonable starting point from which you might start. Note that that the images, videos, and references for this presentation also must be downloaded or commented out in order for the presentation to compile to pdf. Here is a template talk example.tex and refs.bib to get you started.
A PDF outlining the steps is available here.
Group 1 : “No Brainer”
Group 2 : “SOS”
Group 3 : “Mind Blowing”
Michaelmas
Week | Date | Due | Activity | Reading |
---|---|---|---|---|
1. | 10/10 | Groups | Intro Lecture (Wood) | Chemical processing |
2. | 17/10 | Talks (1,5,9) | ||
3. | 24/10 | video | Guest Lecture (McIntyre) | Cutting technologies |
4. | 31/10 | Log books | Talks (2,6,10) | |
5. | 07/11 | video | Guest Lecture (Turaga) | Recording technologies |
6. | 14/11 | Talks (3,7,11) | ||
7. | 21/11 | Log books / video | Guest Lecture (Kasthuri) | Data Management |
8. | 28/11 | Talks (4,8,12) | Data Processing |
Hilary
Week | Date | Due | Activity | Reading |
---|---|---|---|---|
1. | 16/01 | Challenge problem brief (Wood / Warrington) | slides | |
2. | 23/01 | Decision trees and random forests (Rainforth) | slides | |
3. | 30/01 | Neural networks (Mahendran) | notes slides zip | |
4. | 06/02 | Log books | Challenge Problem Progress Talks (1,5,9) | |
5. | 13/02 | Challenge Problem Progress Talks (2,6,10) | ||
6. | 20/02 | Challenge Problem Progress Talks (3,7,11) | ||
7. | 27/02 | Log books | Challenge Problem Progress Talks (4,8,12) | |
8. | 06/03 | Practice Final Presentations (all groups) |
Trinity
Week | Date | Due |
---|---|---|
0. | 24/04 | Draft of report |
1. | 01/05 | A possible date for final presentation. (to be scheduled) |
2. | 08/05 | A possible date for final presentation. (to be scheduled) |
4. | 12.00 on Wednesday of Week 4 | Reports |
@article{denk2004serial, title = {Serial block-face scanning electron microscopy to reconstruct three-dimensional tissue nanostructure}, author = {Denk, W. and Horstmann, H.}, journal = {PLoS biology}, volume = {2}, number = {11}, pages = {e329}, year = {2004}, publisher = {Public Library of Science} }
@article{knott2008serial, title = {Serial section scanning electron microscopy of adult brain tissue using focused ion beam milling}, author = {Knott, G. and Marchman, H. and Wall, D. and Lich, B.}, journal = {The Journal of Neuroscience}, volume = {28}, number = {12}, pages = {2959--2964}, year = {2008}, publisher = {Soc Neuroscience} }
@article{lichtman2008technicolour, title = {A technicolour approach to the connectome}, author = {Lichtman, J. W. and Livet, J. and Sanes, J. R.}, journal = {Nature Reviews Neuroscience}, volume = {9}, number = {6}, pages = {417--422}, year = {2008}, publisher = {Nature Publishing Group} }
@article{dani2010new, title = {New resolving power for light microscopy: applications to neurobiology}, author = {Dani, A. and Huang, B.}, journal = {Current opinion in neurobiology}, volume = {20}, number = {5}, pages = {648--652}, year = {2010}, publisher = {Elsevier} }
@article{denk1990two, title = {Two-photon laser scanning fluorescence microscopy}, author = {Denk, W. and Strickler, J. H. and Webb, W. W. and others}, journal = {Science}, volume = {248}, number = {4951}, pages = {73--76}, year = {1990} }
@article{kralj2012optical, title = {Optical recording of action potentials in mammalian neurons using a microbial rhodopsin}, author = {Kralj, J. M. and Douglass, A. D. and Hochbaum, D. R. and Maclaurin, D. and Cohen, A. E.}, journal = {Nature methods}, volume = {9}, number = {1}, pages = {90--95}, year = {2012}, publisher = {Nature Publishing Group} }
@article{leighton1980sem, title = {SEM images of block faces, cut by a miniature microtome within the SEM-a technical note.}, author = {Leighton, S. B.}, journal = {Scanning electron microscopy}, number = {Pt 2}, pages = {73--76}, year = {1980} }
@article{schalek2011atum, author = {Schalek, R. and Kasthuri, N. and Hayworth, K. and Berger, D. and Tapia, J. and Morgan, J. and Turaga, S. and Fagerholm, E. and Seung, H. and Lichtman, J.}, title = {Development of High-Throughput, High-Resolution 3D Reconstruction of Large-Volume Biological Tissue Using Automated Tape Collection Ultramicrotomy and Scanning Electron Microscope}, journal = {Microscopy and Microanalysis}, volume = {17}, issue = {Supplement S2}, month = jul, year = {2011}, issn = {1435-8115}, pages = {966--967}, numpages = {2}, doi = {10.1017/S1431927611005708}, url = {http://journals.cambridge.org/article_S1431927611005708} }
@article{hayworth2014atum, author = {Hayworth, K. J. and Morgan, J. L. and Schalek, R.}, title = {Imaging ATUM ultrathin section libraries with WaferMapper: a multi-scale approach to EM reconstruction of neural circuits}, journal = {Frontiers in Neural Circuits}, year = {2014} }
@article{Logothetis2008, author = {Logothetis, N. K.}, title = {What we can do and what we cannot do with fMRI}, journal = {Nature}, year = {2008}, volume = {453}, number = {7197}, pages = {869-878}, url = {http://dx.doi.org/10.1038/nature06976} }
@article{Cohen1968, author = {Cohen, D.}, title = {Magnetoencephalography: evidence of magnetic fields produced by alpha-rhythm currents}, journal = {Science}, year = {1968}, volume = {161}, pages = {784-786}, url = {http://www.sciencemag.org/content/161/3843/784.long} }
@article{Livet2007, author = {Livet, J. and Weissman, T. A. and Kang, H. and Draft, R. W. and Lu, J. and Bennis, R. A. and Sanes, J. R. and Lichtman, J. W.}, title = {Transgenic strategies for combinatorial expression of fluorescent proteins in the nervous system}, journal = {Nature}, volume = {450}, number = {7166}, pages = {56-62}, year = {2007}, url = {http://dx.doi.org/10.1038/nature06293} }
@article{1955BJAP, author = {{Smith}, K. C. A. and {Oatley}, C. W.}, title = {The scanning electron microscope and its fields of application}, journal = {British Journal of Applied Physics}, year = {1955}, month = nov, volume = {6}, pages = {391-399}, url = {http://stacks.iop.org/0508-3443/6/i=11/a=304} }
@article{JMI2024, author = {Mayerich, D. and Abbott, L. and McCormick, B.}, title = {Knife-edge scanning microscopy for imaging and reconstruction of three-dimensional anatomical structures of the mouse brain}, journal = {Journal of Microscopy}, volume = {231}, number = {1}, publisher = {Blackwell Publishing Ltd}, pages = {134-143}, year = {2008}, url = {http://dx.doi.org/10.1111/j.1365-2818.2008.02024.x} }
@article{Helmstaedter2008, title = {3D structural imaging of the brain with photons and electrons}, journal = {Current Opinion in Neurobiology }, volume = {18}, number = {6}, pages = {633 - 641}, year = {2008}, author = {Helmstaedter, M. and Briggman, K. L. and Denk, W.}, url = {http://www.sciencedirect.com/science/article/pii/S0959438809000130} }
@article{Knott2011, title = {Focussed Ion Beam Milling and Scanning Electron Microscopy of Brain Tissue}, journal = {J. Vis. Exp.}, volume = {53}, number = {}, pages = {e2588}, year = {2011}, author = {Knott, G. and Rosset, S. and Cantoni, M.}, url = {http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3196160/} }
@article{Knott2008, author = {Knott, G. and Marchman, H. and Wall, D. and Lich, B.}, title = {Serial Section Scanning Electron Microscopy of Adult Brain Tissue Using Focused Ion Beam Milling}, volume = {28}, number = {12}, pages = {2959-2964}, year = {2008}, journal = {The Journal of Neuroscience}, url = {http://www.jneurosci.org/content/28/12/2959.full} }
@article{Susaki2014, author = {Susaki, E. A. and Tainaka, K. and Perrin, D. and Kishino, F. and Tawara, T. and Watanabe, T. M. and Yokoyama, C. and Onoe, H. and Eguchi, M. and Yamaguchi, S. and Abe, T. and Kiyonari, H. and Shimizu, Y. and Miyawaki, A. and Yokota, H. and Ueda, H. R.}, title = {Whole-Brain Imaging with Single-Cell Resolution Using Chemical Cocktails and Computational Analysis}, volume = {157}, number = {3}, pages = {726-739}, year = {2014}, journal = {Cell}, url = {http://www.cell.com/cell/abstract/S0092-8674(14)00418-8} }
@article{Tie2013, author = {Xia, T. and Li, N. and Fang, X.}, title = {Single-Molecule Fluorescence Imaging in Living Cells}, journal = {Annual Review of Physical Chemistry}, volume = {64}, number = {1}, pages = {459-480}, year = {2013}, url = {http://dx.doi.org/10.1146/annurev-physchem-040412-110127} }
@article{Wang2003, title = {Two-Photon Calcium Imaging Reveals an Odor-Evoked Map of Activity in the Fly Brain }, journal = {Cell}, volume = {112}, number = {2}, pages = {271 - 282}, year = {2003}, author = {Wang, J. W. and Wong, A. M. and Flores, J. and Vosshall, L. B. and Axel, R.}, url = {http://www.cell.com/cell/abstract/S0092-8674(03)00004-7} }
@article{Wilson2007, author = {Wilson, J. M. and Dombeck, D. A. and D{\'\i}az-R{\'\i}os, M. and Harris-Warrick, R. M. and Brownstone, R. M.}, title = {Two-Photon Calcium Imaging of Network Activity in XFP-Expressing Neurons in the Mouse}, volume = {97}, number = {4}, pages = {3118-3125}, year = {2007}, journal = {Journal of Neurophysiology}, url = {http://jn.physiology.org/content/97/4/3118.long} }
@article{palay1962fixation, title = {Fixation of neural tissues for electron microscopy by perfusion with solutions of osmium tetroxide}, author = {Palay, S. L. and McGee-Russell, S. and Gordon, S. and Grillo, M. A.}, journal = {The Journal of cell biology}, volume = {12}, number = {2}, pages = {385--410}, year = {1962}, publisher = {Rockefeller Univ Press} }
@article{williams1975improved, title = {An improved method for perfusion fixation of neural tissues for electron microscopy}, author = {Williams, T. H. and Jew, J. Y.}, journal = {Tissue and Cell}, volume = {7}, number = {3}, pages = {407--418}, year = {1975}, publisher = {Elsevier} }
@article{reynolds1963use, title = {The use of lead citrate at high pH as an electron-opaque stain in electron microscopy}, author = {Reynolds, E. S.}, journal = {The Journal of cell biology}, volume = {17}, number = {1}, pages = {208--212}, year = {1963}, publisher = {Rockefeller Univ Press} }
@article{mikula2012staining, title = {Staining and embedding the whole mouse brain for electron microscopy}, author = {Mikula, S. and Binding, J. and Denk, W.}, journal = {Nature methods}, volume = {9}, number = {12}, pages = {1198--1201}, year = {2012}, publisher = {Nature Publishing Group} }
@article{newman1999resins, title = {Resins for combined light and electron microscopy: a half century of development}, author = {Newman, G. R. and Hobot, J. A.}, journal = {The Histochemical Journal}, volume = {31}, number = {8}, pages = {495--505}, year = {1999}, publisher = {Springer} }
@article{grace1985morphological, title = {Morphological artifacts induced in intracellularly stained neurons by dehydration: circumvention using rapid dimethyl sulfoxide clearing}, author = {Grace, A. and Llinas, R.}, journal = {Neuroscience}, volume = {16}, number = {2}, pages = {461--475}, year = {1985}, publisher = {Elsevier} }
@article{pichugin2006cryopreservation, title = {Cryopreservation of rat hippocampal slices by vitrification}, author = {Pichugin, Y. and Fahy, G. M. and Morin, R.}, journal = {Cryobiology}, volume = {52}, number = {2}, pages = {228--240}, year = {2006}, publisher = {Elsevier} }
@article{kasthuri2015saturated, title = {Saturated reconstruction of a volume of neocortex}, author = {Kasthuri, Narayanan and Hayworth, Kenneth Jeffrey and Berger, Daniel Raimund and Schalek, Richard Lee and Conchello, Jos{\'e} Angel and Knowles-Barley, Seymour and Lee, Dongil and V{\'a}zquez-Reina, Amelio and Kaynig, Verena and Jones, Thouis Raymond and others}, journal = {Cell}, volume = {162}, number = {3}, pages = {648--661}, year = {2015}, publisher = {Elsevier} }
@article{lichtman2011big, title = {The big and the small: challenges of imaging the brain’s circuits}, author = {Lichtman, J. W. and Denk, W.}, journal = {Science}, volume = {334}, number = {6056}, pages = {618--623}, year = {2011}, publisher = {American Association for the Advancement of Science} }
@article{jain2010machines, title = {Machines that learn to segment images: a crucial technology for connectomics}, author = {Jain, V. and Seung, H. S. and Turaga, S. C.}, journal = {Current opinion in neurobiology}, volume = {20}, number = {5}, pages = {653--666}, year = {2010}, publisher = {Elsevier} }
@article{beyer2013connectomeexplorer, title = {ConnectomeExplorer: Query-guided visual analysis of large volumetric neuroscience data}, author = {Beyer, J. and Al-Awami, A. and Kasthuri, N. and Lichtman, J. W. and Pfister, H. and Hadwiger, M.}, journal = {Visualization and Computer Graphics, IEEE Transactions on}, volume = {19}, number = {12}, pages = {2868--2877}, year = {2013}, publisher = {IEEE} }
@inproceedings{burns2013open, title = {The open connectome project data cluster: scalable analysis and vision for high-throughput neuroscience}, author = {Burns, R. and Lillaney, K. and Berger, D. R. and Grosenick, L. and Deisseroth, K. and Reid, R. C. and Roncal, W. G. and Manavalan, P. and Bock, D. D. and Kasthuri, N. and others}, booktitle = {Proceedings of the 25th International Conference on Scientific and Statistical Database Management}, pages = {27}, year = {2013}, organization = {ACM} }
@article{kleissaslarge, title = {Large-Scale Synapse Detection Using CAJAL3D}, author = {Kleissas, D. M. and Roncal, W. G. and Manavalan, P. and Vogelstein, J. T. and Bock, D. D. and Burns, R. and Vogelstein, R. J.} }
@conference{segfusion, title = {Segmentation Fusion for Connectomics}, year = {2011}, month = {06/11/2011}, publisher = {IEEE}, address = {Barcelona, Spain}, author = {Vazquez-Reina, A. and Huang, D. and Gelbart, M. and Lichtman, J. and Miller, E. and Pfister, H.} }
@article{cardona2012trakem2, title = {TrakEM2 software for neural circuit reconstruction}, author = {Cardona, A. and Saalfeld, S. and Schindelin, J. and Arganda-Carreras, I. and Preibisch, S. and Longair, M. and Tomancak, P. and Hartenstein, V. and Douglas, R. J.}, journal = {PloS one}, volume = {7}, number = {6}, pages = {e38011}, year = {2012}, publisher = {Public Library of Science} }
@article{gleeson2010neuroml, title = {NeuroML: a language for describing data driven models of neurons and networks with a high degree of biological detail}, author = {Gleeson, P. and Crook, S. and Cannon, R. C. and Hines, M. L. and Billings, G. O. and Farinella, M. and Morse, T. M. and Davison, A. P. and Ray, S. and Bhalla, U. S. and others}, journal = {PLoS computational biology}, volume = {6}, number = {6}, pages = {e1000815}, year = {2010}, publisher = {Public Library of Science} }
@article{chklovskii2010semi, title = {Semi-automated reconstruction of neural circuits using electron microscopy}, author = {Chklovskii, Dmitri B and Vitaladevuni, Shiv and Scheffer, Louis K}, journal = {Current opinion in neurobiology}, volume = {20}, number = {5}, pages = {667--675}, year = {2010}, publisher = {Elsevier} }
@article{mishchenko2009automation, title = {Automation of 3D reconstruction of neural tissue from large volume of conventional serial section transmission electron micrographs}, author = {Mishchenko, Yuriy}, journal = {Journal of neuroscience methods}, volume = {176}, number = {2}, pages = {276--289}, year = {2009}, publisher = {Elsevier} }
@incollection{andres2008segmentation, title = {Segmentation of SBFSEM volume data of neural tissue by hierarchical classification}, author = {Andres, Bj{\"o}rn and K{\"o}the, Ullrich and Helmstaedter, Moritz and Denk, Winfried and Hamprecht, Fred A}, booktitle = {Pattern recognition}, pages = {142--152}, year = {2008}, publisher = {Springer} }
@article{owens2007gpu, author = {Owens, John D. and Luebke, David and Govindaraju, Naga and Harris, Mark and Krüger, Jens and Lefohn, Aaron E. and Purcell, Timothy J.}, title = {A Survey of General-Purpose Computation on Graphics Hardware}, journal = {Computer Graphics Forum}, volume = {26}, number = {1}, publisher = {Blackwell Publishing Ltd}, issn = {1467-8659}, url = {http://dx.doi.org/10.1111/j.1467-8659.2007.01012.x}, doi = {10.1111/j.1467-8659.2007.01012.x}, pages = {80--113}, year = {2007} }
@article{Jessen20041861, title = {Glial cells }, journal = {The International Journal of Biochemistry and Cell Biology }, volume = {36}, number = {10}, pages = {1861 - 1867}, year = {2004}, issn = {1357-2725}, doi = {http://dx.doi.org/10.1016/j.biocel.2004.02.023}, url = {http://www.sciencedirect.com/science/article/pii/S1357272504000846}, author = {Jessen, R. Kristjan} }
@article{hu2008synapse, author = {Hu, Y. and Qu, L. and Schikorski, T.}, title = {Mean synaptic vesicle size varies among individual excitatory hippocampal synapses}, journal = {Synapse}, volume = {62}, number = {12}, publisher = {Wiley Subscription Services, Inc., A Wiley Company}, issn = {1098-2396}, url = {http://dx.doi.org/10.1002/syn.20567}, doi = {10.1002/syn.20567}, pages = {953--957}, year = {2008} }
@article{schikorski1997synapse, author = {Schikorski, T. and Stevens, C. F.}, title = {Quantitative Ultrastructural Analysis of Hippocampal Excitatory Synapses}, volume = {17}, number = {15}, pages = {5858-5867}, year = {1997}, url = {http://www.jneurosci.org/content/17/15/5858.abstract}, eprint = {http://www.jneurosci.org/content/17/15/5858.full.pdf+html}, journal = {The Journal of Neuroscience} }
@article{luders2002grey, author = {Luders, E. and Steinmetz, H. and Jancke, L.}, journal = {Neuroreport}, keywords = {neurology}, month = dec, number = {17}, pages = {2371-2374}, title = {Brain size and grey matter volume in the healthy human brain.}, volume = {13}, year = {2002} }
@book{shepherd2004synaptic, title = {The Synaptic Organization of the Brain}, author = {Shepherd, G.M.}, isbn = {9780195159561}, lccn = {20342914}, url = {http://books.google.co.uk/books?id=xlCqS0EODUoC}, year = {2004}, publisher = {Oxford University Press, USA} }
Email:
fwood@robots.ox.ac.uk
Office:
IEB 20.03
Address:
Department of Engineering Science
University of Oxford
Parks Road
OXFORD
OX1 3PJ
UK
Phone:
(+44 or 0)
1865 283060
Skype: frank_wood