Main Page

Latest News

We did a course on Edge ML, implementing machine learning on a RP2024 device. This isclude sensor data acquisition, model training and deplyoment, see UBISS2024.

There is now a new page on CircuitPython. This is useful, if you require specific libraries (e.g. emulating a keyboard, mouse, or game controller).

The LMU SKWH 2020 - LMU Sketching with Hardware course (Summer Term 2020) we have completed the Preparation phase (self-paced), and done the Individual Tasks. Please get organized in your group.

We will answer your questions in the discord server (links below).

Todos for you:

• Please provide the planing (time, shopping, milestones, topic) for your group project - see Requirements
• there is a Feedback page - if you encounter(ed) any issue with the information, kit, video - please let us know

Here are some recent changes:

• Introduction to the Workshop in Frauenlobstr.
• There is now more information about the RGB LED including a tutorial video: https://www.youtube.com/watch?v=K2m6ttZ1bJw
• There is an example of how to program the LED Ring NeoPixel
• The page describing the LED is now setup as example
• Tutorial pages are up: Tutorial Basics, Tutorial Digital IO, Tutorial Analog IN, Tutorial Display, and Tutorial Network
• There are pages with the Individual Tasks as well as for the Group Project SoSe2020
• There is a description of the Tasks SoSe2020

Courses

At this point there is only one course (summer term 2020 at LMU) ... but we hope for more in the future.

Please go to the course page for details, timeline, and requirements:

• LMU SKWH 2020 - LMU Sketching with Hardware, Summer Term 2020
• there is also a gallery with results from the last course: Gallery 2020

Foreword and Introduction to Sketching With Hardware

The course is part of our question of how to create functional prototypes for exploring interactive systems. There are some introductory slides ( pptx, pdf) that are shown in the introductory video (https://youtu.be/Irxo9b5cexs).

In the article "Understanding and researching through making: a plea for functional prototypes" (online via ACM DL or as PDF) we discuss three different approaches to create prototypes. In this course, we are focusing custom hardware development for research and development in human-computer interaction.

Learning Goals

The overall learning goal is to equip students with skills to Envision a new interactive physical object and implement it a functional prototype, this includes:

• understand why sketching with hardware is relevant
• understand the challenges in creating function prototypes
• being able to create basic hardware sketches
• being able to program and debug MicroPython on ESP32/ESP8266
• being able to build basic circuits connected to the microcontroller, including
  • output: LEDs, servos, motors, speakers, display
  • input: buttons, dials, sliders, LDR, accelerometer, distance, I2C sensors
• being able to program basic networking (network variables)

Important Links

• Wiki: https://www.sketching-with-hardware.org/wiki and please Create a new account
• Micropython: https://micropython.org/
• If you have questions, please email to swh@um.ifi.lmu.de

Video Tutorials

• Tutorial Basics
• Tutorial Digital IO
• Tutorial Analog IN
• Tutorial Display
• Tutorial Network
• Tutorial AutoRun

List of Videos available

• https://youtu.be/DnBBB8AcvBg Setting up Software on your computer (python, uPyCraft IDE, Putty) [4:20, on Youtube]
• https://youtu.be/_TrKPDOReJc Flashing the MicroPython image onto the ESP32 and ESP8266 microcontroller [17:01, on Youtube]
• https://youtu.be/jhfURkMZVEs Setting it up... What could possibly go wrong when setting it up? [10:32, on Youtube]
• https://youtu.be/e3No4wGGQas What is in the hardware box? [10:19, on Youtube]
• https://youtu.be/0KGgYsEZcZM Digital Output - adding an LED to the controller [30:30 on Youtube]
• https://youtu.be/G6HZ1etMRbM Digital Output - connecting an LED - WebREPL based[16:54 on Youtube]**
• https://youtu.be/XovIHYo7s1A PWM Output - connecting a servo [45:38 on Youtube]**
• https://youtu.be/va1beT6sxLs Digital Input - connecting a switch [30:31 on Youtube]**
• https://youtu.be/gjj5KyK2qGI Analog Input - ADC - connecting a resistor, voltage divider [46:23 on Youtube]**
• https://youtu.be/MXfj_gWf0z4 Uploading and running python files with uPyCraft IDE [6:48 on Youtube]
• https://youtu.be/PJ3nQo_Hw3I Connect the ESP32/ESP8266 to the Internet, IoT, netvars.py [8:52 on Youtube], https://www.sketching-with-hardware.org/files/netvars.py module
• https://youtu.be/UbxwePvgX-U Print to the OLED Display that is mounted to the ESP32 board [22:00 on Youtube], https://www.sketching-with-hardware.org/files/display.zip include the ssd1306.py module and examples to use it
• https://youtu.be/kzgUN_h1bqw Use main.py as entry point to start your MicroPython code [29:23 on Youtube]
• https://youtu.be/K2m6ttZ1bJw Connecting an RGB-LED and programming it with Micropython [31:11 on Youtube]
• https://youtu.be/HPQMvL1SP_c Connecting speakers and an amplifier, creating sounds ==
• https://youtu.be/3J3GbD2PrCs Connecting the analog Joystick
• https://youtu.be/C0W-wI0qHIQ Connecting a PIR motion sensor
• https://youtu.be/EIwjeek5hnM Connecting a stepper motor (28BYJ-48) and driver (ULN2003)
• https://youtu.be/PJdDUZWeIDs Connecting the HC-SR04 distance sensor
• https://youtu.be/YFKACI_TfqA Connecting the MPU-6050 sensor (acceleration, gyro, temperature)