concerned with the structure, function, evolution, and mapping of genomes. Nature Publishing Group The study of the full genetic complement of an organism (the genome). It employs recombinant DNA, DNA sequencing methods, and bioinformatics to sequence, assemble, and analyse the structure and function of genomes.
→ nucleotides form DNA and RNA → amino acids form protein ⇒ The Central Dogma provides a framework of how information flows in biological systems → exceptions and nuances exist The Central Dogma
= sys.argv[1] count = 0 with open(fname, "r") as src: for idx, line in enumerate(src): if idx % 4 == 0 and line.startswith("@"): count += 1 print("There are", count, "records") $ python count.py reads.fq↲ There are 4 records
= sys.argv[1] count = 0 with open(fname, "r") as src: for idx, line in enumerate(src): if idx % 4 == 0 and line.startswith("@"): count += 1 print("There are", count, "records") # what about malformed files? what if we want to do more? $ python count.py reads.fq↲ There are 4 records
= 0 for _ in SeqIO.parse(fname, "fastq"): count += 1 print("There are", count, "records") Task: Count output of a sequencing run $ python count.py reads.fq↲ There are 4 records https://biopython.org
Bio import SeqIO fname = sys.argv[1] count = sum(1 for _ in SeqIO.parse(fname, "fastq")) print("There are", count, "records") $ python count.py reads.fq↲ There are 4 records https://biopython.org
Bio import SeqIO fname = sys.argv[1] count = sum(1 for record in SeqIO.parse(fname, "fastq") if "N" in record.seq) print("There are", count, "records with ambiguous bases") $ python count.py reads.fq↲ There are 2 records with ambiguous bases https://biopython.org
469 bp mRNA linear PRI 03-OCT-2017 DEFINITION Homo sapiens insulin (INS), transcript variant 1, mRNA. ... GenBank annotated sequence format #!/usr/bin/env python import sys from Bio import Entrez, SeqIO # not compulsory but recommended Entrez.email = "[email protected]" gene_id = sys.argv[1] handle = Entrez.efetch(db="nucleotide", id=gene_id, rettype="gb", retmode="text") record = SeqIO.read(handle, "genbank") print("Record of {!r}".format(record.description), "has", len(record.seq), "nucleotides", "and", sum(1 for ft in record.features if ft.type == "exon"), "exons") $ python fetch_and_parse.py NM_000207↲ Record of 'Homo sapiens insulin (INS), transcript variant 1, mRNA' has 469 nucleotides and 3 exons
libraries @HD VN:1.5 SO:coordinate @SQ SN:chrQ LN:45 r002 99 ref 7 30 8M2I4M1D3M = 37 39 TTAGATAAAGGATACTG EFGGFGGFGFGFGFEEE r002 147 ref 37 30 9M = 7 -39 CAGCGGCAT GEFEEFGGE NM:i:1 .... SAM/BAM genome alignment format ⇒ has its own compression and encoding format ⇒ unpacking requires considerably more CPU ⇒ parseable using pysam, a wrapper around htslib, a C library. ⇒ pysam uses Cython to talk to htslib and define its own functions ⇒ Cython is also used in some parts of numpy
fib(n): a, b = 0.0, 1.0 for i in range(n): a, b = a + b, a return a # pure Cython def fib(int n): cdef int i cdef double a = 0.0, b = 1.0 for i in range(n): a, b = a + b, a return a // pure C double cfib(int n) { int i; double a = 0.0, b = 1.0, tmp; for (i = 0; i < n; ++i) { tmp = a; a = a + b; b = tmp; } return a; } # Cython wrapping C cdef extern from "fib.h": double cfib(int n) def fib(int n): return cfib(n) fib(0) : 590 ns (1x) fib(90): 12,852 ns (1x) fib(0) : 2 ns (295x) fib(90): 164 ns (~78.3x) fib(0) : 90 ns (~6.5x) fib(90): 258 ns (~49.8x)
fib(n): a, b = 0.0, 1.0 for i in range(n): a, b = a + b, a return a # pure Cython def fib(int n): cdef int i cdef double a = 0.0, b = 1.0 for i in range(n): a, b = a + b, a return a // pure C double cfib(int n) { int i; double a = 0.0, b = 1.0, tmp; for (i = 0; i < n; ++i) { tmp = a; a = a + b; b = tmp; } return a; } # Cython wrapping C cdef extern from "fib.h": double cfib(int n) def fib(int n): return cfib(n) fib(0) : 590 ns (1x) fib(90): 12,852 ns (1x) fib(0) : 2 ns (295x) fib(90): 164 ns (~78.3x) fib(0) : 90 ns (~6.5x) fib(90): 258 ns (~49.8x) python C cython C .so python compiled to compiled to imported by python X
workflow that analyzes RNA-seq samples of leukemia patients ⇒ nodes indicate execution of a command-line tool ⇒ edges indicate job dependencies ⇒ real world use involves many more steps and is run on multiple inputs
runs on my machine!" (bio)conda ⇒ Applies ideas from Python virtualenv to generic command-line tools and libraries ⇒ bioconda is one distribution channel built on conda (which is built with Python) ⇒ "conda install my_awesome_package" Highlights ⇒ YAML for defining environments ⇒ YAML for defining build steps ⇒ automated deployment using a continuous integration platform ⇒ automated Docker container builds Task: Publish & share tools https://bioconda.github.io/
pipeline developed using Snakemake [source] ⇒ parts of analysis published as Python notebooks [source] ⇒ various Python scripts published in GitHub ⇒ package available in Bioconda
bow
daitak
oztick139
__allllllllez__
usaito
nina01
riyaamemiya
ryysud
nakamuuu
lycorptech_jp
ham0215
manarobot
inductor
mclloyd
smashingmag
geoffreycrofte
tenderlove
sonatard
mojombo
frogandcode
afnizarnur
zakiyama
erikaheidi
aarron
shlominoach
![import sys from Bio import SeqIO fname = sys.argv[1] count](https://files.speakerdeck.com/presentations/1ed2762b829249338b72d18e0b9f7c8f/slide_11.jpg){kind=link}
