A Panoramical Controller in TouchOSC

21 September 2015

Panoramical1

Panoramical is out, and it’s been lovely to play with: a series of visual and sonic canvases to manipulate and explore.

I’ve been keen to play it partly because of its support for interesting controllers not traditionally associated with videogames. An early version was played with the eight faders of the Korg Nanokontrol; Brendan Byrne built a limited edition controller, the Panoramical Pod, for the final release. What’s really interesting is that Panoramical also supports any controller that spits out MIDI – and so I started thinking about building my own controller(s) for it. I’ve long been interested in controller design, and have built a few unusual interfaces for music and computers in recent years. So I got to thinking about what I could do with Panoramical.

The world of Panoramical is manipulated via eighteen variables. These are describe inside Panoramical as nine, two-axis variables. With a keyboard and mouse, you hold a key (or selection of keys) to pick variables to manipulate, and move the mouse to alter them.

The Pod has a row for the “horizontal” component of a variable, and a row for the “vertical” component of a variable. I’m not sure this is a elegant or interesting as controlling both axes with a single input. I investigated non-spring-returning analogue joysticks, much like found on the VCS3, but they all appear to be horrendously expensive as components. (Cheaper joysticks, that would need the spring removing, have an unpleasant deadzone, which I don’t think would be ideal for Panoramical).

And then I had an idea: rather than building a controller out of hardware, I could start by building one in TouchOSC.

TouchOSC is a programmable control surface for iOS and Android tablets that spits out MIDI or OSC data. It’s possible to design interfaces yourself, in an editor on a computer, before transferring the UI to your tablet. You can then connect the tablet TouchOSC app to a ‘bridge’ on your computer in order to spit out MIDI data to anything that can receive it.

One of the many UI components on offer is an X-Y pad.

Panoramical2

This is my controller for Panoramical. Nine X-Y pads, in a 3×3 grid – much like the lower left of the screen. It didn’t take too long to lay this out, although I went back and added some padding around the pads – otherwise, you’d slide off one into another, leading to unintentional lurches in values.

It didn’t take long to layout, although it really didn’t help that touchOSC doesn’t rotate its understanding of ‘vertical’ and ‘horizontal’ when you design a landscape mode – that was confusing for a while.

Panoramical3

I also added a second ‘page’ with eighteen rotary encoders, as per the official Panoramical Pod. I don’t use this to play Panoramical, but it makes it much easier to configure the mapping.

Is it fun to play with?

I definitely think so. The multitouch UI gives you control over many parameters at once, and the coupling of the related variables (each XY pair basically control similar elements, but have different effects) makes a lot of sense – the design of touchOSC’s pads even mirrors the visualisation in the lower right of the screen. It’s also fun to be able to use ten digits to play it, manipulating many things at once; it makes Panoramical feel even more like an instrument to be played, explored, and improvised with.

You can download my TouchOSC mapping here, if you’d like, and you can find out more about TouchOSC here. TouchOSC’s documentation is reasonably good, so I’m afraid I cant provide support on getting it running. Suffice to say: you’ll need the layout on your touch device, and the Bridge running on your computer. In Panoramical, set the MIDI input to TouchOSC Bridge, and then I recommend mapping the controls from the ‘rotaries‘ page on your device – it’s much easier to map from there – then, you can play Panoramical from the ‘pads’ page.

games , , , , ,
  • "x-OSC is a wireless I/O board that provides just about any software with access to 32 high-performance analogue/digital channels via OSC messages over WiFi. There is no user programmable firmware and no software or drivers to install making x-OSC immediately compatible with any WiFi-enabled platform. All internal settings can be adjusted using any web browser." Small, simple, wireless OSC-transmitting board; really nice idea, simply implemented, and noted down as a way of simplifying certain kinds of projects in future…
    (tags: osc hardware electronics prototyping )
  • "His base is too good, and I don’t have the choke. He proceeds to take a more dominant position, scores points, and my body is burning from the effort. The choke he applies toward the end of the match is almost a formality, since I’m far too tired to do much more than hang on. Second place. Second place because I’m learning the triangle choke, not learning Jiu Jitsu. Chipp never wins tournaments." A fantastic piece of writing, about beat-em-ups and combat sports, and the mindset you get into as you play both. I'm not a combat sports man, but it nails some of the inside of your brain when you've played a lot of beat-em-ups, for sure.
    (tags: mma brazilianjiuitsu insertcredit fighters games writing )
  • "But to my eye, GIF is the most popular animation and short film format that's ever existed. It works on smartphones in millions of people's pockets, on giant displays in museums, in web browsers on a newspaper website. It finds liberation in constraints, in the same way that fewer characters in our tweets and texts freed us to communicate more liberally with one another. And it invites participation, in a medium that's both fun and accessible, as the pop music of moving images, giving us animations that are totally disposable and completely timeless."
    (tags: culture gifs animation internet )
  • "My wife and I talk about this. We talk about the protocol of the fertility clinic. We talk about her support group, and failure to produce. We talk about adoption, which is expensive and ambiguous. We talk about giving up on the process and living our lives without the ghosts of unconceived children (the most adorable ghosts there are). We talk, and talk, and wait." Powerful, sad, brave writing from Paul Ford. Sometimes, you wish things were nice for the good people in the world.
    (tags: paulford writing fertility themorningnews medicine )
  • "I needed to get up to speed with doing recursive node structures so I coded up a project that would put a dot on the screen. When you tapped this dot, it would create a bunch of orbiting child-dots. These children could also be tapped, creating even more child nodes. This prototype took less than a day to create and I naively thought we would be done with the whole thing in a week, max. Silly me."

    Marvellous, dense post from Robert on designing Planetary: lots of show-everything, material exploration, and plussing. What detail looks like.

    (tags: design software bloom planetary detail plussing )
  • "Years later, when recounting his conversations with Beckett (which he did often), André the Giant revealed that they rarely talked about anything besides cricket."
    (tags: history wrestling beckett cricket )
  • "In this scenario one sunny day you're working on low-level NoSQL projects at the Gootch or wherever, and you get an email from Facebook and you go for the interview and Zuckerberg is talking about scaling PHP and suddenly pauses, gets this look in his eye, pulls his hoodie over his head and says “You have sixty seconds. You should be running.” Because engineers, as we are often reminded, are the ultimate prey."
    (tags: facebook google plus social interviewtechnique paulford )
  • "A problem with the human mind – your human mind – is that it's a horrific kludge that will fail when you most need it not to. The Ugh Field failure mode is one of those really annoying failures. The idea is simple: if a person receives constant negative conditioning via unhappy thoughts whenever their mind goes into a certain zone of thought, they will begin to develop a psychological flinch mechanism around the thought. The "Unhappy Thing" – the source of negative thoughts – is typically some part of your model of the world that relates to bad things being likely to happen to you."
    (tags: psychology mind stupidlizardbrain )
  • "Designers get handed a tool kit that has as many tools as a good swiss army knife, and the maps reflect these tools. Millions of people use them to make appointments across town, find restaurants, and drive home for the holidays.

    But what if, instead of a swiss army knife, we used a box of crayons? Or charcoal and newsprint? Or play-doh? What would those maps look like? What could they tell us about the world?"

    (tags: data design maps mapping stamen whynotmakeitpretty )
  • "One thing that I learned during the launch of the original Macintosh in 1984 was that the press usually oversimplifies everything, and it can't deal with the reality that there are many people playing critical roles on significant projects. A few people always get too much credit, while most people get too little, that's just the way it has always worked. But luckily, it's 2011 and I can use the service that I helped to create to clarify things." This is Good And Proper. (Also it's good management).
    (tags: management design credit google googleplus )
  • How ads used to be made. Some beautiful photographs here.
    (tags: design advertising sugarwater history )
  • Useful notes on the modern way of deploying Rails applications with Bundler and Capistrano.
    (tags: rails capistrano bundler ruby deployment )
  • '"The expectation is slightly weird here, that you can do this stuff without killing yourself," added McNamara. "Well, you can't, whether it's in London or New York or wherever; you're competing against the best people in the world at what they do, and you just have to be prepared to do what you have to do to compete against those people."'

    This is what McNamara considers responding to controversy. I'm furious that men like this are allowed to manage other human beings.

    (tags: management industry games workingpractice quality brendanmcnamara asshat )
  • "This is an atlas, then, made by that other nature, seen through other eyes. But those eyes have been following me, unseen and without permission, and thus I consider provoking breach a necessary act." This is good.
    (tags: book location privacy mapping breach robots )
  • "csvkit is a library of utilities for working with CSV, the king of tabular file formats." Ooh.
    (tags: data csv shell commandline )
  • "Synapse is an app for Mac and Windows that allows you to easily use your Kinect to control Ableton Live, Quartz Composer, Max/MSP, and any other application that can receive OSC events. It sends joint positions and hit events via OSC, and also sends the depth image into Quartz Composer. In a way, this allows you to use your whole body as an instrument." Oooh. OSC into anything; really nice, dead simple, and exactly the sort of thing I've been considering poking.
    (tags: kinect osc computervision )