October 18, 2018

Creative Technology Weekly #2

Creative Technology Weekly

Hello there!

In this week's findings you'll find projects around AR, music and machine learning, 
Hope you enjoy!

Charlie

---

Projects

---

Invisible highway - Jam3
Invisible Highway is an experience that lets users draw a road in virtual space and have a physical robot interact with it, brought to life using ARCore.

Google is announcing a set of new experimental features for developers to use on the Lenovo Mirage Solo - the standalone Daydream headset. 

Piano Genie - An Intelligent Musical Interface
Piano Genie is an intelligent controller that maps 8-button input to a full 88-key piano in real time using machine learning.

Weather Thingy - Real time climate sound controller
Weather Thingy is a custom built sounds controller that uses real time climate-related events to control and modify the settings of musical instruments.

A platform for algorithmic composition on p5.js
An interactive and explorable tutorial on algorithmic music composition with JavaScript and p5.js-sound.

Tools

---

tfjs-yolo-tiny - Fast in-browser object detection
This JavaScript module uses Tensorflow.js and a pre-trained model to detect objects in a camera feed in the browser.

Vimeo depth viewer
An OpenGL application for viewing depth and color video streams from Intel RealSense cameras (D415/D435).


Introducing project Aero
Adobe released a preview of their Project Aero, a new augmented reality authoring tool that makes it easier for designers to create immersive content.
Ngx - Neural network based visual generator and mixer
Ngx is an attempt at utilizing a neural network for VJing. It implements pix2pix as an ad-hoc next-frame prediction model that is trained with pairs of consecutive frames extracted from a video clip.

Videos

---

Andante - Tangible Media Group
A projection of animated characters on a piano to visualize musical motion.

Upcoming events

---

UAL's Creative Computing Institute opens its doors to applicants
The University of the Arts London (UAL) has announced details of its new Creative Computing Institute – which has now begun recruiting its first students to its academic programmes, beginning September 2019.