Water Programming - Slide Deck In Process

ConferencesVRSTProceedingsVRST '12Underwater augmented reality game using the DOLPHYN`

Underwater augmented reality game using the DOLPHYN

  • Authors:
  • Abdelkader Bellarbi


  • Christophe Domingues


  • Samir Otmane


  • Samir Benbelkacem


  • Alain Dinis

Authors Info & Claims

VRST '12: Proceedings of the 18th ACM symposium on Virtual reality software and technologyDecember 2012 Pages 187–188https://doi.org/10.1145/2407336.2407372

VRST '12: Proceedings of the 18th ACM symposium on Virtual reality software and technology

Underwater augmented reality game using the DOLPHYN

Pages 187–188

ACM Digital Library


The introduction of virtual and mixed realities in aquatic leisure activities constitutes a technological rupture when compared with the status of related technologies. With the extension of Internet to underwater applications, the innovative character of the project becomes evident, and the impact of this development in the littoral and beach tourism may be considerable. In fact, there are recent developments to extend the use of computers and computer components, such as the mouse, to underwater uses. The Dolphyn is an underwater-computerized display system with various sensors and devices conceived for existing swimming pools and for beach shores, associating computer functions, video gaming and multisensory simulations.


  1. L. Blum, W. Broll, S. Müller, “Augmented Reality under water”, SIGGRAPH '09, ACM New York, NY, USA 2009 Google ScholarDigital Library
  2. C. Domingues, S. Otmane and A. Dinis, “A new Device for Virtual or Augmented Underwater Diving”, in “IEEE Symposium on 3D User Interface (3DUI 2012), Orange County, CA : USA (2012)”.Google Scholar
  3. Wagner, D., Schmalstieg, D. “ARToolKitPlus for Pose Tracking on Mobile Devices”, Proceedings of 12th Computer Vision Winter Workshop. (CVWW’07), pp. 139–146, 2007Google Scholar

Index Terms

  1. Underwater augmented reality game using the DOLPHYN
  2. Human-centered computing

1. [Human computer interaction (HCI)](https://dl.acm.org/topic/ccs2012/10003120.10003121?ContentGroupKey=10.1145%2F2407336&expand=all)
1 Like

(Note the magenta imprinting)

WaterHCI Part 1: Open Water Monitoring with Realtime Augmented Reality

Steve Mann, Faraz Sadrzadeh-Afsharazar, Samir Khaki, Zhao Lu, Christina Mann and Jaden Bhimani MannLab Canada, 330 Dundas Street West, Toronto, Ontario, M5T 1G5

Abstract—This is the first of our two accepted papers in this conference so we are presenting it as Part 1 in the new and growing field known as Water-HCI or WaterHCI (Water- Human-Computer Interface/Interaction/Intersection). WaterHCI originated in the 1960s and 1970s as a form of water in- teraction, water monitoring, water-based augmented reality / extended reality, and the like. Much of this work began with hydraulophones (underwater musical instruments) in the 1960s and underwater Augmented Reality (AR) or eXtended Reality (XR) with the SWIM (Sequential Wave Imprinting Machine) in the 1970s. SWIM is a sensing and meta-sensing (sensing-of- sensing) tool with real-world applications in the XR visualization of otherwise invisible phenomena. In this paper, SWIM is applied to understanding open water, such as at beaches, to realtime understanding of water characteristics, and their spatial variations. A sensor and meta-sensor pod was developed and can be towed behind a swimmer to provide immediate XR feedback of the current water characteristics to enable the swimmer to choose an optimal path to swim. Part 2 of WaterHCI was also developed based on autonomous crafts, drones, and the like to sense water quality and generate an XR “heatmap” that shows spatial variations of water properties such as water temperature, turbidity, conductivity, etc., made visible to a swimmer’s head-up display in realtime.

Index Terms—SWIM (Sequential Wave Imprinting Machine), Augmented Reality (AR), eXtended Reality (XR), Sensing, Meta- sensing, Open water, Water reservoir, Robotics, Autonomous sensing, Digital Signal Processing (DSP)


In this paper, SWIM (Sequential Wave Imprinting Machine) is combined with concepts that will lead us toward a new approach to citizen science and outdoors education, etc., to develop an innovative beach water quality sensing tool, and to build on the concept of a “TeachBeachTM ” [1], [2] that will be further developed in Part 2 of this 2-part paper series.

SWIM arises from early experiments in WaterHCI, which itself has grown as a new field of research [2]. See Fig 1.

A. SWIM (Sequential Wave Imprinting Machine)

The SWIM (Sequential Wave Imprinting Machine) is an augmented reality / extended reality (XR) system, invented in 1974, which allows users to see, understand, and photograph otherwise invisible phenomena [4]–[7], and has been explored in the context of X-band (10 GHz) marine radar [3], [5], e.g. chirplet-based sensing of “growlers” (iceberg fragments).

A note on terminology:

  • Ice floe: 20m to 10km across;
  • Iceberg: > 15m long;
  • Growler < 1m high, <5m long.

Fig. 1: Our TeachBeachTM that we developed at Ontario Place as an outdoor classroom to explore the new field of WaterHCI. Here we are teaching the Headflow Taxonomy for water-human-machine-interaction. Growlerboarding is a new sport that grew out of research on WaterHCI. Participants stand on small ice fragments while paddling in icewater, along with controlled cold- water exposure exercise and health benefits while the movement of the growler is monitored by marine radar [3].

978-1-6654-4940-3/22/$31.00 © 2022 IEEE

-3dB -3dB

Kustom TR-6 Doppler radar

SWIM Waveform

Direction of Motion …

Sand as Acoustic Damper




Water Trough




Fig. 2: SWIM was discovered when an RCA TMV-122 cathode-ray oscil- lograph that had no working timebase (pictured upper leftmost) was moved back-and-forth while connected to the output of a Doppler radar set. Here an Eico 460 oscilloscope (which has a larger and brighter screen than the RCA) is moved in a similar way to show the phenomenon. In some experiments the oscilloscope was moved on rollers, and in others it was upon a vessel moving in a water trough to attain smooth movement. In some experiments the oscilloscope was replaced with a linear array of light sources and a set of comparators forming a one-dimensional digital display that was moved back and forth in front of an X-band police radar or marine radar set. This provided an augmented reality overlay requiring no special eyeglasses to see, since the waveform overlay can be seen directly by the naked human eye, and it can also be photographed as in the photograph shown.

S.W.I.M. 1974



Sand as Acoustic Damper


Rx Hydrophone

SWIM Waveform

Direction of Motion

There are 21 cycles of this sound wave over its
1.5 metre distance of travel.

Each cycle is 150cm/21 = 7cm long.

Row of green lights moves with speaker and displays output of lock-in amplifier from microphone.

Measured speed of sound
= 0.07 metres/cycle * 5000 cycles/second
= 350 m/s. (True value at 27deg. C is 347m/sec)

Tx Hydrophone


Δφ Lock-in θ Amp R

Fig. 3: Here a stationary transmitter creates soundwaves that are explored upon a moving vessel. A receiver on the moving vessel drives a one-dimensional display that is waved back-and-forth to make the waveform visible. The display is co-located with the receiver so that it shows a true and accurate waveform of what is present at the receiver. A lock-in amplifier is used instead of the homodyne receiver principle of the Doppler radar.

Two early embodiments of this invention are shown in Fig 2 and Fig 3. Fig 2 depicts an early discovery of the SWIM concept. A one-dimensional display moved in front of a Doppler radar, in which the display is connected to the baseband Doppler output, causes a Doppler shift proportional to movement velocity, and thus self-displays the waveform, though compressed to 1/2 space-scale, e.g. with approximately 5cm wavelength (instead of 10cm). Fig 3 shows a slight variation in which the transmitter and receiver are separate, and one moves with the vessel while the other remains stationary. This configuration corrects for the error of 1/2 in the spatialization. Here we can see underwater soundwaves.

A modern version of SWIM as a tool for education and teaching is shown in Fig. 4.

SWIM senses a variety of physical phenomena, and it is also used to sense sensing itself (i.e. for meta-sensing). Just as a meta-conversation is a conversation about conversations, and meta-data is data about data, meta-sensing is the sensing of sensors and the sensing of their capacity to sense [8]. Fig. 4 depicts the sensing of sensing (e.g. sensing a microphone’s capacity to sense, and sensing a motion sensor’s capacity to sense). In addition, SWIM can also be used to depict various otherwise invisible phenomena, such as the interference pat- tern between two microphones in air, or hydrophones under- water, as seen in 5. Recordings of data (metaveillogrammetry) and photographs (metaveillogrammetry) of sound wave prop- agation can be used to infer water qualities and charateristics. In this way SWIM is a WaterHCI medium of artistic and scientific discovery and exploration for playing in and with water and exploring its properties through TinquiryTM, which is “tinkering” as a form of inquiry (e.g. learning through unstructured aquatic play).

B. Mersive Reality (“Mersivity”)

Virtual, Augmented, and eXtended Reality (VR, AR, and XR) can virtualize, augment, and extend human sensory capabilities. The MannLab Mersivity underwater VR/AR/XR headset is used (See Fig. 6) to visualize spatially-varying beach water characteristics such as temperature, conductivity,

Fig. 4: SWIM (Sequential Wave Imprinting Machine) is an array of LEDs connected to a lock-in amplifier allowing us to see and understand a variety of physical phenomena, and is useful in STEM education. (Top) Seeing and photographing the capacity of a microphone to sense sound waves. (Bottom) Seeing and photographing electromagnetic radio waves (electric field in green LEDs and magnetic field in magenta) from a microwave motion sensor [7].

turbidity, etc., as “heat maps” overlayed onto the water while we swim. The practical benefit of augmented reality is that it can assist swimmers in picking the most swimmable paths or patches of open water.


Existing water quality sensor systems use proprietary tech- nology which decreases interoperability and limits access to data, especially by citizen scientists and others operating in a GNU Linux open-source “home built” environment. With waterHCI technologies we empower the citizen scientists with technology able to conduct water quality measures. This in- terface between water and humans allows us to extend the ca- pabilities of human sensing with a device that measures water quality indicators, including pH, dissolved oxygen, turbidity, temperature, conductivity, nitrates, phosphorus, optical clarity, and solid particulates. This waterHCI technology allows the

Function Gen.


SWIM Computer


This moving speaker emits a 5000 CPS (Cycles Per Second) tone, which this microphone hears.

Lock-in amplifiers.


S.W.I.M. 1974, SONAR

Fig. 5: WaterHCI SWIMbot in air and water… Top left: Photographs of the interference pattern between the capacity to sense of two Shure SM58 microphones. SWIMbotTM apparatus including Lock-in amplifier can also be seen, reproduced from [7]. Top right, hydrophones instead of microphones, within an eXtended Reality (XR) WaterHCI environment (40kHz). Bottom row: sensing and understanding water quality by photographing the interference patterns of sound wave propagation in the water (metaveillography), and also by metaveillogrammetry. Left: 40kHz. Right: 100kHz.

Fig. 6: The MannLab Mersivity VR/AR/XR headset, pictured here at one of the three beaches under test, was used for realtime visualization of spatially- varying beach water characteristics, “heatmap” overlays, etc., while swimming in the water.

user to experience real-time AR graphs and virtual maps as they interact with their environment. We summarize the contributions as:

  • continuous data collection allows for a real-time under- standing of environmental status;
  • the spatial resolution of a moving sensor yields far more data points than manual collection at just 1 or 2 (or a small number of) points;
  • the open-source nature allows for interoperability with other smart systems and enables further development by third parties;
  • open-access allows more people and organizations to benefit from the data and develop new methods of pro- cessing/understanding water quality monitoring data;We hope that the proposed system will enable the citizen scientists and broader public to engage with waterHCI tech- nologies and participate in the social activity of water quality measurements.III. EXPERIMENTAL SETUPTo ensure efficacy of the experiment, two setups were de- veloped, one powered by an individual swimmer, and the other by way of a “smart SUP” (smart Stand Up Paddleboard). The first setup features a swimmer towing a SWIM-based sensor pod in a free-form pattern enabling real-time visualization of heat map data across the aquatic environment - See Fig. 7.For the second setup, the SUP is used - See Fig. 10.IV. EXPERIMENTAL PROCEDUREWe devised a prototype that includes a temperature sensor that is connected to the Analog-to-Digital Converter pin on an Arduino nano. A SWIM, as outlined in [9], is also connected to the Arduino nano to be used as a visualization tool, where the temperature of the water being measured shall be used to determine which LED of the 32 LEDs along the SWIM will light up, with the top LED denoting a water temperature of 25.3°C and the bottom LED denoting a temperature of 24.8 °C (i.e. scaled to the range of surface water temperatures present in the lake where the participants are swimming).A Fluke 28II underwater multi-meter with a thermocouple probe was used as a reference to calibrate the results of the temperature sensor in the sensor pod apparatus. For example, the pod gives a measurement of 25.3 °C with the multi-meter

giving a reading of 25.7°C. The results indicate a 1.556% error margin, which we considered to be acceptable for a system used for teaching purposes.

The prototype sensor pod was towed by either a human swimmer or a SUP across the test area. While conducting the experiment, a long exposure photograph is taken of the appa- ratus moving across the water. Hence, a light trail indicating the correlation between the spatial coordinates and the water temperature is recorded on the photograph, as is typical with SWIM [8].

When light levels permitted (i.e. when it was dark enough) long-exposure photographs were taken and saved, to create additional data overlays.


The modular nature of the proposed system allowed the sen- sor pod to function either as something towed by a swimmer (Fig. 9), or by a SUP.

A. Sensor pod towed by swimmer

As demonstrated by Fig. 9, a rope was used to tow the sensor pod behind a swimmer. The distance between the apparatus and the swimmer were pre-determied as 1.5m so the apparatus would not drift sideways and flip over due to the effect of the waves (when the distance was too short), and still provide data close to the swimmer (e.g. while the swimmer is wearing the Mersivity VR/AR/XR), more relevant data is displayed). Wearable sensors may also be used when we wish to exactly co-locate the data to the swimmer, but phenomena like water temperature are then affected more strongly by the swimmer.

This approach was adopted for us to test one of the potential use cases of the apparatus and also served the purpose for us to test for multiple times without the fear of running out of battery power compared to the autonomous watercraft approach. However, even the most experienced swimmer, albeit with ability to out-last an autonomous watercraft across multiple tests, cannot sustain a relatively constant speed across a single test since the swimmer will slow down due to the drain of stamina - this is something we address in Part 2 of WaterHCI.

B. Sensor pod towed by SUP

A SUP was considered as a second option to the swimmer- towed sensor pod. The modular design of the sensor pod allowed us to attach it to the paddleboard for furhter testing and experiementation. By joining these two technologies, we presented the smart SUP. Further, we redeveloped the output mechanism for the sensor pod as to display the data via a SWIM stick attached to the read. The SWIM stick featured a 1x144 NeoPixel RGB LED strip attached to a wooden stick mounted on the SUP behind the paddler(individual operating the SUP). An Arduino uno was mounted to the top of the stick as a portable micro-controller allowing us to control both data printed graphically and the initial display text to indicate the quantity being sensed. An algorithm was developed to

Phenomenological Representation of Temperature

2 4 . 8 oC

Sequential Wave Imprinting Machine (SWIM)

Direction of Motion


Fig. 7: Sensor pod and sequential wave imprinting machine being towed by swimmer. A realtime heatmap is generated and continuously updated while the swimmer pulls the pod through the water, while its position is tracked by a drone hovering overhead. Realtime “heatmaps” are available for viewing.

o 25.3 C

Sensor Pod


Fig. 8: Demonsration of SWIM stick on SUP where text indicates the E- Coli levels of the beach, obtained from the official city of Toronto website. Following the text, a fixed-frequency sine wave indicated the speed of the SUP. As can be seen in the photo, the SUP moves slower as it travels from left to right, as shown with an apparent increase in frequency in the long exposure photo.

print characters via changing the colour of the LED array. We selected the 5x8 ECE835 font as a point of reference, as each font pixel was equal to 17 pixels length-wise and 1-pixel width-wise which fell within the range of the number SWIM stick LED’s. As seen in 8 where said algorithm is used to display the E-Coli levels of the beach water, followed by a constant-frequency sine wave used to display the speed of the SUP.

The ardunio UNO also had two analog input signals con- nected to two potentiometers that could be controlled by the user for adjusting speed and brightness. The developed printing algorithm adjusted the iteration speed of printing, proportionally for each pixel column in the character as to not distort the phrase and or data quality being printed. Likewise the brightness values were scaled to prevent clipping. Since the circuit was an input to the microcontroller, it allowed on the fly edits without having to restart the program each time - beneficial for collecting continuous sets of data when on the water.

One experiment to monitor water quality was performed using this setup in various bodies of water. A Wavetek model 185 signal generator was connected to a speaker which gener-

Fig. 9: Sensory and meta-sensory payload being towed by swimmer. As seen in the photo, the pod is towed at a fixed distance from the swimmer’s rear allowing it to collect data from the path of the swimmer as they interact with their aquatic environment.

ated a fixed-frequency sine wave and was placed underwater. A SYSUxMannLab Model 1024SO lock-in amplifier was then connected to a microphone attached to the paddle used to operate the SUP, whose signal was fed into the lock- in amplifier and broken down into its real and imaginary components. The amplitude of the resulting signal was fed into another analog input of the Arduino microcontroller which normalized its values between 0 and 142. After printing the display text(”WATER QUALITY”), the signal output from the lock-in amplifier displayed as a multi-pixels point as to prevent aliasing. We applied an exponential dropoff on the point illumination from the SWIM stick as to enhance precision of it’s position when viewed from the camera. As the paddler moved over the water, they expand a 1D slice of data into a spatial mapping of the signal over the water. The height of the dot was indicative of the signal strength while it’s horizontal positioning in the image is simply a spatial mapping of the swimmer’s sensor data over time. See fig 10, where we show

Fig. 10: Sensing and metasensing by way of paddleboard with SWIM (Sequen- tial Wave Imprinting Machine) moving with the sensors and metasensors. In the former image, one can see signal strength slowly increasing and decreasing as the SUP approaches then gets farther away from the source over time. In the latter, one can notice the general chaos and incoherence of the signal strength even as the SUP passes the audio source, indicating much less clear transmission.

experimental results.


We created a VR/AR/XR system to help understand and teach principles of environmentalism with regards specifically to understanding of beach water, and the spatial variation of beach water characteristics. This is an important first step towards developing a system to understand, teach, and care for our beaches, and to create an outreach program to educate the public about the importance of beach water quality.


A sensor/meta-sensor pod was developed for being either towed by a swimmer, or by a paddleboard. This provided realtime water sensing and meta-sensing so as to help guide a swimmer, as well as to help in the understanding of the beach. Graphical renderings were produced in realtime, and when conditions permitted (e.g. in subdued lighting) long-exposure photographs were also made using a SWIM (Sequential Wave Imprinting Machine).

This resulted in an epistemological understanding of the beach water, and its various properties and qualities.


Future work will involve the creation of a sensory and meta- sensory beach environment system that helps conservation authorities and others teach the natural beauty of coastal areas, and deepen our understanding of our environment.

Additional sensors will be used on the sensor pods to conduct real-time analysis of the water quality based on the measurements to provide real-time feedback to the user where the system shall guide the user through VR/AR/XR towards areas with safe swim characteristics to provide better health.


We would like to thank Cayden Pierce for help in writing up some of the motivations, goals, objectives, etc., and Liam Cassano for help with the boat design. We also thank Kyle for help with the underwater SWIMbot (underwater robotic SWIM) and many other aspects of the research. Thanks also to AMD for donation of the WaterHCI server (waterhci.com) and Vuzix for donation of the SmartSwims, and to the McLuhan Program and our Priveillance Working Group (priveillance.com), as well as the 794 members of SwimOP.com for help in creating the TeachBeachTM and SwimOP = Swim at Ontario Place community.


[1] S. Mann and M. Hrelja, “Praxistemology: Early childhood education, engineering education in a university, and universal concepts for people of all ages and abilities,” in 2013 IEEE International Symposium on Tech- nology and Society (ISTAS): Social Implications of Wearable Computing and Augmediated Reality in Everyday Life. IEEE, 2013, pp. 86–97.

[2] S. Mann, M. Mattson, S. Hulford, M. Fox, K. Mako, R. Janzen, M. Burhanpurkar, S. Browne, C. Travers, R. Thurmond, S. min Park, A. Roufas, C. Pierce, S. Khaki, D. Lam, F. Sadrzadeh-Afsharazar, K. Simmons, T. Yonezawa, and A. Manzoor, “Water-Human-Computer- Interface (WaterHCI): Crossing the borders of computation, clothes, skin, and surface,” in Proceedings of the 23rd annual Water- Human-Computer Interface Deconference, Ontario Place TeachBeach, Toronto, Ontario, Canada, 12 2021, pp. 6–35. [Online]. Available: Water-Human-Computer-Interface (WaterHCI): Crossing the Borders of Computation, Clothes, Skin, and Surface | Zenodo

[3] S. Mann and S. Haykin, “The chirplet transform: A generalization of Gabor’s logon transform,” Vision Interface ’91, pp. 205–212, June 3-7 1991, iSSN 0843-803X.

[4] “Steve mann,” Campus Canada, ISSN 0823-4531, p55 Feb-Mar 1985, pp58-59 Apr-May 1986, p72 Sep-Oct 1986.

[5] S. Mann, “Wavelets and chirplets: Time–frequency perspectives, with applications,” in Advances in Machine Vision, Strategies and Applications, world scientific series in computer science - vol. 32 ed., P. Archibald, Ed. Singapore . New Jersey . London . Hong Kong: World Scientific, 1992.

[6] P. Scourboutakos, M. H. Lu, S. Nerker, and S. Mann, “Phenomenologi- cally augmented reality with new wearable led sequential wave imprinting machines,” in Proceedings of the Tenth International Conference on Tangible, Embedded, and Embodied Interaction. ACM, 2017, pp. 751– 755.

[7] S. Mann, “Phenomenological Augmented Reality with SWIM,” pp. 220– 227, IEEE GEM2018.

[8] ——, “Surveillance, sousveillance, and metaveillance,” pp. 1408–1417, CVPR2016.

[9] S. Mann, P. V. Do, Z. Lu, and J. K. K. Lau, “Sequential wave imprinting machine (swim) implementation using sdr (software-defined radio),” in 2020 Seventh International Conference on Software Defined Systems (SDS). IEEE, 2020, pp. 123–130.


This feels really big. Not sure what to make of it, but I’m thinking about RFK Jr. “liquid robotics” DARPA surfboards in a new light.


Immersive reality with stuff over your face seems super dangerous underwater. What are they doing? Is this some sort of sensory mix-up / deprivation thing?


@Stephers I think maybe this is what the person was talking about in the online chat last night.


Fast forward 13.79999 billion years to 1932 when Harold C. Urey and his colleagues Ferdinand G. Brickwedde and George R. Murphy at Columbia University proved the existence of deuterium. Before their discovery it was believed hydrogen contained one proton and one electron. This rare heavier isotope of hydrogen with an added neutron doubles the weight and has a mass of 2. Deuterium had gone undetected by physicists perhaps because it only made up 0.0149% of all hydrogen in the Universe, or 1 heavy water molecule for every 3300 of regular water molecules in seawater.

1 Like

When Steve Mann brought up the world Primordial, two things popped into my mind Primary water and time. I don’t know if he is aware of primary water, I just feel like there is a possible connection there. I’m reading Vine Deloria Jr’s book ‘C.G. Jung and the Sioux Traditions: Dreams, Visions, Native and the Primitive’ and he is a member of the Sioux Nation and he name was mentioned in Steven Newcomb’s book ‘Pagan’s in The Promised Land: Decoding the Doctrine of Christian Discovery’ and the chapter I am currently reading is about the ‘Sioux Universe’ and how there are similarities with the Jungian Universe (there a number of really important differences too).

One of similarities being perceptions on time, the Sioux view time and space as being inseparable for people and other being and that it is also relative. Jung shares this view point in that he thought the psyche, time and space weren’t inseparable either. The Sioux also see time as relative, and that there is a universe time (energy) behind ordinary time that actively participates with us (call Jung called them synchronicity) and this energy expresses itself though dreams, visions and so on… @AMcD During the livestream a couple of nights ago, you mentioned time artifacts, what if there obsession with water and time is because they want to control this universal time, and as you said, put in artifacts that increases their probability of controlling an outcome. Like maybe they want to be able to sense the incoming synchronicities and influence them.

The already do this with astrology, I think they know how to read charts and transits to take advantage of what ever energy is coming from the cosmos.

I went onto Steve Mann’s youtube channel and found this music video on Time and water. Notice the necklacs the lady is wearing.

Also with the water fountains, Crystal Fountain is head quartered in Toronto Canada, and I found a blog post of theirs that I will be reading through.


Yes, precisely.

A photo of the one bottle of DDW I have (unopened):

I purchased it years ago from this company:

@Stephers A few nights ago I watched the preprogramming movie ‘Johnny Mnemonic’ directed by Robert Longo and stars Keanu Reeves as Johnny Smith (interesting that the characters last name is Smith because this movie takes place about two years before the first Matrix movie.)

I also looked up Keanu Reeve’s profile, and his father was a Geologist

The move is based on the story by the same name, written by Canadian Author William Gibson, who coined the term cyberpunk. There is a lot of preprogramming with this movie, especially the metaverse and digital twins. The story revolves around Johnny (Keanu Reeves) being a Mnemonic agent, who transports data via his head. He uploads some important data, that a big pharma corporation wants back as it has information about a cure (it’s interesting that the move is set in 2021).

In one scene, Johnny reaches a place called Heaven where people called the ‘low-techs’ live, and they are helping Johnny get the data out of his head. He goes to see Jones, who is revealed to be a dolphin who can cyberhack the navy, and Jones helps Johnny retrieve the key so he can get the data.

The movie is available on Netflix

1 Like

I will definitely check this out. Thank you!

Jason recently told Alison, Jen, and I about an upcoming TV series based on William Gibson’s The Peripheral:

Joy graduated from Stanford University and worked as a consultant at McKinsey & Company in Los Angeles before attending Harvard Law School.[3] Joy was admitted to the bar in 2009 and practiced law in California prior to her career in entertainment.[4]

P.S. I was actually going to start a new thread about this individual today – but never got around to it – Kip Thorne:

Nolan wrote the screenplay for Interstellar , a science-fiction feature based on the works of theoretical physicist Kip Thorne, who served as the film’s executive producer.[7] Christopher Nolan co-wrote, directed and produced the film, with Paramount distributing domestically, while Warner Bros. distributed internationally.

Kip Stephen Thorne (born June 1, 1940) is an American theoretical physicist known for his contributions in gravitational physics and astrophysics. A longtime friend and colleague of Stephen Hawking and Carl Sagan, he was the Richard P. Feynman Professor of Theoretical Physics at the California Institute of Technology (Caltech) until 2009[3] and is one of the world’s leading experts on the astrophysical implications of Einstein’s general theory of relativity. He continues to do scientific research and scientific consulting, most notably for the Christopher Nolan film Interstellar.[4][5] Thorne was awarded the 2017 Nobel Prize in Physics along with Rainer Weiss and Barry C. Barish “for decisive contributions to the LIGO detector and the observation of gravitational waves”.[6][7][8][9]


Life and career[edit]

Discussion in the main lecture hall at the École de Physique des Houches (Les Houches Physics School), 1972. From left, Yuval Ne’eman, Bryce DeWitt, Thorne, Demetrios Christodoulou.

Thorne was born on June 1, 1940, in Logan, Utah.[citation needed] His father, D. Wynne Thorne (1908–1979), was a professor of soil chemistry at Utah State University, and his mother, Alison (née Comish; 1914–2004), was an economist and the first woman to receive a Ph.D. in economics from Iowa State College.[10][11] Raised in an academic environment, two of his four siblings also became professors.[12][13] Thorne’s parents were members of The Church of Jesus Christ of Latter-day Saints (LDS Church) and raised Thorne in the LDS faith, though he now describes himself as atheist. Regarding his views on science and religion, Thorne has stated: “There are large numbers of my finest colleagues who are quite devout and believe in God … There is no fundamental incompatibility between science and religion. I happen to not believe in God.”[14]

Thorne rapidly excelled at academics early in life, winning recognition in the Westinghouse Science Talent Search as a senior at Logan High School.[15] He received his B.S. degree from the California Institute of Technology (Caltech) in 1962, and his Ph.D. from Princeton University in 1965 under the supervision of John Archibald Wheeler with a doctoral dissertation entitled “Geometrodynamics of Cylindrical Systems”.[[16]](Kip Thorne - Wikipedia)

Thorne returned to Caltech as an associate professor in 1967 and became a professor of theoretical physics in 1970, becoming one of the youngest full professors in the history of Caltech at age 30. He became the William R. Kenan, Jr. Professor in 1981, and the FeynmanProfessor of Theoretical Physics in 1991. He was an adjunct professor at the University of Utah from 1971 to 1998 and Andrew D. White Professor at Large at Cornell University from 1986 to 1992.[17] In June 2009, he resigned his Feynman Professorship (he is now the Feynman Professor of Theoretical Physics, Emeritus) to pursue a career of writing and movie making.[citation needed] His first film project was Interstellar, on which he worked with Christopher Nolan and Jonathan Nolan.[3]

Throughout the years, Thorne has served as a mentor and thesis advisor for many leading theorists who now work on observational, experimental, or astrophysical aspects of general relativity. Approximately 50 physicists have received Ph.D.s at Caltech under Thorne’s personal mentorship.[3]

Thorne is known for his ability to convey the excitement and significance of discoveries in gravitation and astrophysics to both professional and lay audiences. His presentations on subjects such as black holes, gravitational radiation, relativity, time travel, and wormholes have been included in PBS shows in the U.S. and on the BBC in the United Kingdom.[citation needed]

Thorne and Linda Jean Peterson married in 1960. Their children are Kares Anne and Bret Carter, an architect. Thorne and Peterson divorced in 1977. Thorne and his second wife, Carolee Joyce Winstein, a professor of biokinesiology and physical therapy at USC, married in 1984.[18]


Thorne in 1972

Thorne’s research has principally focused on relativistic astrophysics and gravitation physics, with emphasis on relativistic stars, black holes and especially gravitational waves.[3] He is perhaps best known to the public for his controversial theory that wormholes can conceivably be used for time travel.[19] However, Thorne’s scientific contributions, which center on the general nature of space, time, and gravity, span the full range of topics in general relativity.

Gravitational waves and LIGO[edit]

Thorne’s work has dealt with the prediction of gravitational wave strengths and their temporal signatures as observed on Earth. These “signatures” are of great relevance to LIGO (Laser Interferometer Gravitational Wave Observatory), a multi-institution gravitational wave experiment for which Thorne has been a leading proponent – in 1984, he cofounded the LIGO Project (the largest project ever funded by the NSF[20]) to discern and measure any fluctuations between two or more ‘static’ points; such fluctuations would be evidence of gravitational waves, as calculations describe. A significant aspect of his research is developing the mathematics necessary to analyze these objects.[21] Thorne also carries out engineering design analyses for features of the LIGO that cannot be developed on the basis of experiment and he gives advice on data analysis algorithms by which the waves will be sought. He has provided theoretical support for LIGO, including identifying gravitational wave sources that LIGO should target, designing the baffles to control scattered light in the LIGO beam tubes, and – in collaboration with Vladimir Braginsky’s (Moscow, Russia) research group – inventing quantum nondemolition designs for advanced gravity-wave detectors and ways to reduce the most serious kind of noise in advanced detectors: thermoelastic noise. With Carlton M. Caves, Thorne invented the back-action-evasion approach to quantum nondemolition measurements of the harmonic oscillators – a technique applicable both in gravitational wave detection and quantum optics.[3]

On February 11, 2016, a team of four physicists[a] representing the LIGO Scientific Collaboration, announced that in September 2015, LIGO recorded the signature of two black holes colliding 1.3 billion light-years away. This recorded detection was the first direct observation of the fleeting chirp of a gravitational wave and confirmed an important prediction of Einstein’s general theory of relativity.[22][23][24][25][26]

Black hole cosmology[edit]

Main article: Hoop conjecture

A cylindrical bundle of magnetic field lines

While he was studying for his Ph.D. in Princeton University, his mentor John Wheeler gave him an assignment problem for him to think over: find out whether or not a cylindrical bundle of repulsive magnetic field lines will implode under its own attractive gravitational force. After several months wrestling with the problem, he proved that it was impossible for cylindrical magnetic field lines to implode.[27]: 262–265

Why is it that a cylindrical bundle of magnetic field lines will not implode, while spherical stars will implode under their own gravitational force? Thorne tried to explore the theoretical ridge between the two phenomena. He found out eventually that the gravitational force can overcome all interior pressure only when an object has been compressed in all directions. To express this realization, Thorne proposed his hoop conjecture, which describes an imploding star turning into a black hole when the critical circumference of the designed hoop can be placed around it and set into rotation. That is, any object of mass M around which a hoop of circumference egin{matrix} rac{4 i GM}{c^2} nd{matrix} can be spun must be a black hole.[27]: 266–267 [28]: 189–190

As a tool to be used in both enterprises, astrophysics and theoretical physics, Thorne and his students have developed an unusual approach, called the “membrane paradigm”, to the theory of black holes and used it to clarify the “Blandford-Znajek” mechanism by which black holes may power some quasars and active galactic nuclei.[27]: 405–411

Thorne has investigated the quantum statistical mechanical origin of the entropy of a black hole. With his postdoc Wojciech Zurek, he showed that the entropy of a black hole is the logarithm of the number of ways that the hole could have been made.[27]: 445–446

With Igor Novikov and Don Page, he developed the general relativistic theory of thin accretion disks around black holes, and using this theory he deduced that with a doubling of its mass by such accretion a black hole will be spun up to 0.998 of the maximum spin allowed by general relativity, but not any farther. This is probably the maximum black-hole spin allowed in nature.[3]

Wormholes and time travel[edit]

A wormhole is a short cut connecting two separate regions in space. In the figure the green line shows the short way through wormhole, and the red line shows the long way through normal space.

Thorne and his co-workers at Caltech conducted scientific research on whether the laws of physics permit space and time to be multiply connected (can there exist classical, traversable wormholes and “time machines”?).[29] With Sung-Won Kim, Thorne identified a universal physical mechanism (the explosive growth of vacuum polarization of quantum fields), that may always prevent spacetime from developing closed timelike curves (i.e., prevent backward time travel).[30]

With Mike Morris and Ulvi Yurtsever, he showed that traversable wormholes can exist in the structure of spacetime only if they are threaded by quantum fields in quantum states that violate the averaged null energy condition (i.e. have negative renormalized energy spread over a sufficiently large region).[31] This has triggered research to explore the ability of quantum fields to possess such extended negative energy. Recent calculations by Thorne indicate that simple masses passing through traversable wormholes could never engender paradoxes – there are no initial conditions that lead to paradox once time travel is introduced. If his results can be generalized, they would suggest that none of the supposed paradoxes formulated in time travel stories can actually be formulated at a precise physical level: that is, that any situation in a time travel story turns out to permit many consistent solutions.[citation needed]

Relativistic stars, multipole moments and other endeavors[edit]

With Anna Żytkow, Thorne predicted the existence of red supergiant stars with neutron-star cores (Thorne–Żytkow objects).[32] He laid the foundations for the theory of pulsations of relativistic stars and the gravitational radiation they emit. With James Hartle, Thorne derived from general relativity the laws of motion and precession of black holes and other relativistic bodies, including the influence of the coupling of their multipole moments to the spacetime curvature of nearby objects,[33] as well as writing down the Hartle-Thorne metric, an approximate solution which describes the exterior of a slowly and rigidly rotating, stationary and axially symmetric body.

Thorne has also theoretically predicted the existence of universally antigravitating “exotic matter” – the element needed to accelerate the expansion rate of the universe, keep traversable wormhole “Star Gates” open and keep timelike geodesic free float “warp drives” working. With Clifford Will[34] and others of his students, he laid the foundations for the theoretical interpretation of experimental tests of relativistic theories of gravity – foundations on which Will and others then built. As of 2005, Thorne was interested in the origin of classical space and time from the quantum foam of quantum gravity theory.[citation needed]

1 Like

Just FYI in that IEEE talk Steve Mann mentioned being tapped to be an advisor on the film “Lawnmower Man,” which is a horror film, and he was really upset because he didn’t want people to think immersive reality would be dark like that.

" Angelo learns the drugs have been swapped and confronts Jobe, who captures him and declares his plan to reach an ultimate stage of evolution by becoming a being of “pure energy” existing in the VSI computer mainframe, connecting to all computer systems of the world afterward. He promises his “birth” will be signaled by every telephone on the planet ringing simultaneously."


Given talk of water, sensory deprivation, dolphins, information theory, and signaling . . . It is probably appropriate to discuss John LIlly:


September 2014

John Lilly, The Mind of the Dolphin, and Communication Out of Bounds

Bruce Clarke
Texas Tech University



1 Like

I have had a chance to watch Interstellar yet and will check it out, Christopher Nolan also directed Tenet, where he talks about time and moving in time both forwards and backwards.

1 Like

See my piece here on Nolan’s Tenet:

1 Like

This goes deep guys! @Stephers @quantumheartcafe @AMcD Just got into it and trying to rap my brain around this water programing thing. I have been busy building a 3000 foot hiking trail to the Robertson River falls. It has consumed my time lately. Kind of got obsessed in doing it. Something is pushing me there for some reason. I am all about water these days so this topic is very important to me. Thanks for the heads up on this one!

I found a spring coming out of nowhere along the upper part of the trail close to the falls. Located about 200 feet up hill. I think it is coming from the same primary water source as the falls and other small rivers in this area. It is still not conclusive to me that this is in fact primary water, but everything so far is leading there. I plan on setting up a pipe and tapping into the little spring so I can get drinking water for my own consumption. This pure water I am hoping will help keep my body and brain rejuvenated as we move forward.


Ok - I have been thinking about Steven Mann’s fixation on the first “cyborgs” being people on boats. I was just looking back at @jenlake 's post on Crow’s and this passage stood out to me.

" Coronis is accordingly said to have been a vessel or float, whose extremities were equally raised and turned up like a crescent… By Coronis is signified a ship which has its two ends bent and turned up… The name was adapted to vessels of this form, from their representing the lunar emblem, the mystical machine Selene. This was the original Coronis and the name was given from a bird of the sea.” The bird-of-the-sea who flew with the dragon-headed ships that carried it were once the Raven-painted sails of the Norsmen who set these oracular birds on the shoulders of their highest lord Odin (Woden)."

What do you make of this @Stephers @jenlake

Yeah! Just getting back from a few days away, but I was reading through this thread last night making the same connection to Corona being a “boat”:

“The concept of ‘cyborg’ has been in existence for more than a million years. Vessels were the first cyborg prosthesis, long before the invention of clothing, or even the existence of homo sapiens. Fundamental to the essence of cyborgs is freedom, freedom to explore, and to cross borders of land, ocean, skin, clothes, and body. This thinking leads to a cyborg taxonomy/ontology based primarily on the concept of “border” as defined by skin, clothing, vessel, or fluid boundary (“interface” in both its meanings). A Type I cyborg arises when an organism enters a vessel and a Type II cyborg arises when a vessel enters an organism. The primordial essence of cyborg is fundamentally connected to border/interface, and therefore remains deeply connected to its nautical origins even as it evolved to the more cosmic/ cosmonautical (i.e., from sea-ship to space-ship).” https://www.waterhci.com/1stborgs.pdf

1 Like

Think crescent - lunar - lunar punk (blend of solar punk and cypher punk) and Datura moon flower

See this @leo and @Jason_Bosch about lunar punk from the Celo talk.

"Lunarpunk is a more tentative aesthetic, existing as a lesser-defined genre when compared to others. It is regarded as the sibling aesthetic of Solarpunk. Lunarpunk, to its more universal properties, references witchcraft, futuristic design, nature, renewable energy, and the circle of life. These worlds focus on introverted details of oneself and/or the environmental setting rather than a greater community or singular “one.” As Tumblr user solarisrebellio words it, “…you would be more likely to see small sects of persons worshipping (or devoting to) The Self rather than The Other.”

“Lunar,” in the context of this aesthetic, references the moon, its cycles, phases, and activities, and by extension, lunar witchcraft, the sea, and the night. “Punk” intends to reference both the futuristic setting of a Lunarpunk society as well as the struggle against a more suspicious, mysterious government/overruling power. Visuals of the aesthetic are borrowed from pagan, satanic, Wiccan, or anarchist references, and the architecture is a mixture of futuristic shapes as well as mushroom-inspired, luminescent, nature-based designs.

In symbolism and tarot, the moon represents things such as illusion, subconscious, higher self, emotions, and change."

Ok @Stephers @jenlake @leo @Jason_Bosch

I read this and I’m starting to feel like that Tarot booth in the atrium (heart) of Bell Labs wasn’t coincidental. It was imprinting - down to the tether - Luna coin.

"So, it’s clear the lunarpunk operates side-by-side with solarpunk, with a duality that’s often characterized by the yin and yang symbol. The presence of spirituality as a defining feature is really what seperates lunarpunk from solarpunk.

Where solarpunk is a calculating genre that places a focus on the breakdown of societal structures—politics, religion, media, etc.—lunarpunk embraces the loose structure of spirituality and champions individuality."

Also @stephers - note the sunflowers

@jenlake in the logo - the crescents on either side of the circle - circuit, crow?

BTW I didn’t spend a long time there, but I walked by, noticed it, walked to the other atrium and walked back to take a picture. I never saw anyone in the booth.

Is lunar punk meant to be sort of the opposite of the hypercycle? Chaos from order?

Ok then - it’s Amy Novack from Central, NJ - her feature image is a crow and a rose.

1 Like

The logo immediately reminded me of this – as I saw it the other day when exploring the Cetus (sea monster) material:

It can also be represented this way:

…Invoking an eclipse – sun (solarpunk) and moon (lunarpunk) side by side (unity and duality in one image)