3. Packages and applications

This part of the Scipy lecture notes is dedicated to various scientific packages useful for extended needs.

• 3.1. Statistics in Python
  • 3.1.1. Data representation and interaction
    • 3.1.1.1. Data as a table
    • 3.1.1.2. The panda data-frame
  • 3.1.2. Hypothesis testing: comparing two groups
    • 3.1.2.1. Student’s t-test: the simplest statistical test
    • 3.1.2.2. Paired tests: repeated measurements on the same indivuals
  • 3.1.3. Linear models, multiple factors, and analysis of variance
    • 3.1.3.1. “formulas” to specify statistical models in Python
    • 3.1.3.2. Multiple Regression: including multiple factors
    • 3.1.3.3. Post-hoc hypothesis testing: analysis of variance (ANOVA)
  • 3.1.4. More visualization: seaborn for statistical exploration
    • 3.1.4.1. Pairplot: scatter matrices
    • 3.1.4.2. lmplot: plotting a univariate regression
  • 3.1.5. Testing for interactions
  • 3.1.6. Full examples
    • 3.1.6.1. Examples
• 3.2. Sympy : Symbolic Mathematics in Python
  • 3.2.1. First Steps with SymPy
    • 3.2.1.1. Using SymPy as a calculator
    • 3.2.1.2. Exercises
    • 3.2.1.3. Symbols
  • 3.2.2. Algebraic manipulations
    • 3.2.2.1. Expand
    • 3.2.2.2. Simplify
  • 3.2.3. Calculus
    • 3.2.3.1. Limits
    • 3.2.3.2. Differentiation
    • 3.2.3.3. Series expansion
    • 3.2.3.4. Integration
    • 3.2.3.5. Exercises
  • 3.2.4. Equation solving
    • 3.2.4.1. Exercises
  • 3.2.5. Linear Algebra
    • 3.2.5.1. Matrices
    • 3.2.5.2. Differential Equations
• 3.3. Scikit-image: image processing
  • 3.3.1. Introduction and concepts
    • 3.3.1.1. scikit-image and the SciPy ecosystem
    • 3.3.1.2. What’s to be found in scikit-image
  • 3.3.2. Input/output, data types and colorspaces
    • 3.3.2.1. Data types
    • 3.3.2.2. Colorspaces
  • 3.3.3. Image preprocessing / enhancement
    • 3.3.3.1. Local filters
    • 3.3.3.2. Non-local filters
    • 3.3.3.3. Mathematical morphology
  • 3.3.4. Image segmentation
    • 3.3.4.1. Binary segmentation: foreground + background
    • 3.3.4.2. Marker based methods
  • 3.3.5. Measuring regions’ properties
  • 3.3.6. Data visualization and interaction
  • 3.3.7. Feature extraction for computer vision
• 3.4. Traits: building interactive dialogs
  • 3.4.1. Introduction
  • 3.4.2. Example
  • 3.4.3. What are Traits
    • 3.4.3.1. Initialisation
    • 3.4.3.2. Validation
    • 3.4.3.3. Documentation
    • 3.4.3.4. Visualization: opening a dialog
    • 3.4.3.5. Deferral
    • 3.4.3.6. Notification
    • 3.4.3.7. Some more advanced traits
• 3.5. 3D plotting with Mayavi
  • 3.5.1. Mlab: the scripting interface
    • 3.5.1.1. 3D plotting functions
    • 3.5.1.2. Figures and decorations
  • 3.5.2. Interactive work
    • 3.5.2.1. The “pipeline dialog”
    • 3.5.2.2. The script recording button
  • 3.5.3. Slicing and dicing data: sources, modules and filters
    • 3.5.3.1. An example: inspecting magnetic fields
    • 3.5.3.2. Different views on data: sources and modules
  • 3.5.4. Animating the data
  • 3.5.5. Making interactive dialogs
    • 3.5.5.1. A simple dialog
    • 3.5.5.2. Making it interactive
  • 3.5.6. Putting it together
• 3.6. scikit-learn: machine learning in Python
  • 3.6.1. Loading an example dataset
    • 3.6.1.1. Learning and Predicting
  • 3.6.2. Classification
    • 3.6.2.1. k-Nearest neighbors classifier
    • 3.6.2.2. Support vector machines (SVMs) for classification
  • 3.6.3. Clustering: grouping observations together
    • 3.6.3.1. K-means clustering
  • 3.6.4. Dimension Reduction with Principal Component Analysis
  • 3.6.5. Putting it all together: face recognition
  • 3.6.6. Linear model: from regression to sparsity
    • 3.6.6.1. Sparse models
  • 3.6.7. Model selection: choosing estimators and their parameters
    • 3.6.7.1. Grid-search and cross-validated estimators