Agenda: Python Advanced (2023-11-22 - 2023-11-24)

Available Material

• Python Programming

Day 1: Basic Python

Exercise Prerequisites: The Commandline

• Commandline Arguments (sys.argv)

• Commandline Parsing with argparse

Datatypes, Datatypes

Audience consists of experienced programmers in other languages, so I expect to go over these topics rather quickly. We should not miss the central points though, like Python’s referencing scheme, im/mutability, memory management, typing. And iteration of course 😎. Everything’s an object, alas.

• Variables

• Datatypes

• Compound Datatypes

• Sequential Datatypes

• Indexing and Slicing

• The range Function

• More About Strings

• String Formatting

• Miscellaneous String Methods

• More About Lists

• More About Dictionaries

• More About Sets

• References, (Im)mutability

• File I/O

Functions

• Functions (Slideshow)

• Functions: Global and Local Scope (Livehacking Screenplay)

Looping Constructs (With An Emphasis On The else Clause)

• while Loops

• for Loops

Generators

• The Iterator Protocol

• Implementing A Fibonacci Number Generator

Miscellaneous

• Comprehensions (List, Dictionary, Set)

• Modules and Packages

Day 2: Group Project Kickoff, Advanced Topics

Group Project Kickoff

Create a semi-realistic application, put together in a typical Python project. Solve problems as we go (for example: at some point in the project is will be necessary to formalize error handling; that will lead us to exceptions)

An idea: Data Logger

• Data acquisition: gathering sensor data

• Varying kinds of sensors: physical hardware, internet proxy, MQTT, …

• Varying kinds of information sinks: CSV, database, MQTT, …

• Acquisition machinery: timestamping, frequency, buffering, …

Project Management, Test Driven Development

Project Management

• Python Package Index

• Virtual Environments

• Package Installation (setuptools)

Test Driven Development

• Establish mindset

• pytest Introduction, By Example

• pytest fixtures

  • How to use temporary directories and files in tests

  • How to monkeypatch/mock modules and environments

Object Oriented Programming

From Object Oriented Programming …

• Classes And Dictionaries

• Constructor

• Methods

• str() And repr()

• Properties

• collections.namedtuple

• Inheritance

• Operator Overloading

• Abstract Base Classes (abc), And Duck Typing

Postpone most of that, start with classes and bring in the rest later.

Error Handling And Recovery

• Exception Handling

• Context Managers: The with Statement

Day 3: More Advanced Topics (All The Rest, And More)

Note that this is much more than we will actually have time for - most of it is optional.

MQTT

Bring that into the project somehow (find a use case 😇)

• MQTT

• json — JSON encoder and decoder

CSV And Databases

• CSV Files

• Databases

Closures, Decorators And More

• Positional and Keyword Arguments

• Closures

• Decorators

Dynamic Features

• The exec() Function

• The eval() function

Multithreading

The GIL

• GIL, over at the Python Wiki

• David Beazley: Understanding the Python GIL (Youtube)

• Multithreading (Python)

• Race Conditions, and Mutexes

• queue — A synchronized queue class

Data Science Topics

• Pandas

• From Machine Learning, Artificial Intelligence

  • Machine Learning: Concepts and Terminology

  • Linear Regression

  • K-Means

• NumPy: Cite Python (12.11.2019 - 14.11.2019 in Graz)