Conda, PyGotham 2015 - Speaker Deck

Slide 1

Slide 1 text

No content

Slide 2

Slide 2 text

No content

Slide 3

Slide 3 text

CONDA PACKAGE AND ENVIRONMENT MANAGER LANGUAGE AGNOSTIC CROSS-PLATFORM Python R Java OS X Linux Windows Scala

Slide 4

Slide 4 text

No content

Slide 5

Slide 5 text

CO NDA INSTALL PYTHO N=3.4 M O NG O DB PYTHO N=2.7 R SPARK NUTCH R-M ATRIX PANDAS NUM PY FLASK NO DE

Slide 6

Slide 6 text

No content

Slide 7

Slide 7 text

CONDA IS OPEN SOURCE https://github.com/conda BSD licensed

Slide 8

Slide 8 text

ANACONDA MINICONDA PYTHON CONDA PACKAGES PYTHON CONDA a bunch of for scientific computing and data science

Slide 9

Slide 9 text

No content

Slide 10

Slide 10 text

CONDA VS PIP(+VIRTUALENV) CONDA PIP Language agnostic Python packages handles environments ! natively virtualenv installs binaries compiles from source general purpose ! envs python! envs

Slide 11

Slide 11 text

CONDA + PIP $ conda install pip $ pip install foo CONDA SKELETON PYPI $ conda skeleton pypi foo $ conda build foo/

Slide 12

Slide 12 text

WHY USE CONDA? Seen this message too many times:“Storing debug log for failure in /.pip/pip.log” Python with compiled, platform- dependent C, C++, or Fortran code Multi-language Data Science Projects

Slide 13

Slide 13 text

No content

Slide 14

Slide 14 text

No content

Slide 15

Slide 15 text

ANACONDA.ORG ~GITHUB FOR BINARY PACKAGES $ conda build conda.recipe/ $ conda server upload my_foo_pkg $ conda install -c chdoig my_foo_pkg

Slide 16

Slide 16 text

No content

Slide 17

Slide 17 text

No content

Slide 18

Slide 18 text

ANACONDA.ORG/R $ conda install -c r r-foo

Slide 19

Slide 19 text

No content

Slide 20

Slide 20 text

No content

Slide 21

Slide 21 text

ENVIRONMENT.YML name: myenv! channels:! - chdoig! - r! - foo! dependecies:! - python=2.7! - r! - r-ldavis! - pandas! - mongodb! - spark=1.5! - pip! - pip:! ! ! ! - ﬂask-migrate! ! ! ! - bar=1.4

Slide 22

Slide 22 text

$ conda env create $ source activate myenv CREATE AND ACTIVATE

Slide 23

Slide 23 text

FREEZE VERSIONS $ conda env export -n freeze.yml name: pygotham-topic! dependencies:! - certiﬁ=14.05.14=py27_0! - gensim=0.10.3=py27_0! - ipython=3.2.1=py27_0! - ipython-notebook=3.2.1=py27_0! - jinja2=2.8=py27_0! - jsonschema=2.4.0=py27_0! - libsodium=0.4.5=2! - markupsafe=0.23=py27_0! - mistune=0.7=py27_0! - ncurses=5.9=1! - nltk=3.0.4=np19py27_0! - numpy=1.9.2=py27_0!

Slide 24

Slide 24 text

UPLOAD ENVIRONMENTS TO ANACONDA.ORG $ conda server upload my_foo_env.yml $ conda env create chdoig/my_foo_env.yml

Slide 25

Slide 25 text

No content

Slide 26

Slide 26 text

CONDA AUTO ENV cdoig:~$ cd pygotham-topic-modeling/ discarding /anaconda/bin from PATH prepending /anaconda/envs/pygotham-topic/bin to PATH (pygotham-topic)cdoig:~/pygotham-topic-modeling$ https://github.com/chdoig/conda-auto-env

Slide 27

Slide 27 text

No content

Slide 28

Slide 28 text

CONDA.PYDATA.ORG

Slide 29

Slide 29 text

No content

Slide 30

Slide 30 text

CONTINUUM.IO/BLOG/CONDA-DATA-SCIENCE

Slide 31

Slide 31 text

No content

Slide 32

Slide 32 text

CONTINUUM.IO

Slide 33

Slide 33 text

No content

Slide 34

Slide 34 text

https://speakerdeck.com/chdoig/conda-pygotham-2015 @ch_doig Christine Doig, Data Scientist Introduction to Topic Modeling in Python PyGotham 2015, Sun 3.30pm