MagAO-X Engineering Run 2024B Day 6: Soldering up loose ends

[A peek behind the sausage factory curtain of blog ops: There was a brief moment on Friday night when I could have written this post but decided to go to sleep instead. 36 hours later, I am frenetically making up on lost time from the courtyard of a hostel in the Bellavista neighborhood of Santiago. The hostel has Wifi but doesn’t allow me to connect to Slack, so I can’t post photos of most things I’m writing about. Sorry.]

After our final dinner on the mountain, were joined by the resident electrical engineer to consult about finding a resistor for the cam LLOWFS shutter that we installed earlier this week. “I know it’s Friday evening”, Jared said, “but is it possible to do this tonight?” “Every day is the same here,” Pato replied. “Except for Sundays, when there are empanadas.”

Ninety minutes later we had a working shutter and a satisfied PI. “That’s a nice small victory at the end of the trip.” There were several frustrations, setbacks and difficulties with this engineering run. Good progress was made however across the board, and I think that all of us left the mountain feeling satisfied about the time spent through the process.

Last sunset of LCO was a beautiful one

The main reason why I went to LCO this October was to overhaul the PIAA (phase induced amplitude apodization) system so that it could be used without needing alignment on-sky. The system consists of four lenses which need to be immaculately aligned with respect to each other. Relative translations of as little as 10um between lenses cause dramatic PSF degradation, meaning that previous runs required opening up the system after coupling to the telescope, and gingerly turning hand-knobs while squinting at a lagging video feed of starlight. No combination of the Thorlabs or Newport catalogues carried actuated lens assemblies that could provide this level of two-axis remote alignment, so we decided to machine picomotor interfaces into the existing cage plates that we’d been using to hold our optics. Getting the rough optomechanics to work with the old design did have some difficulties, and scientists that enjoy playing “find the shim” will see one in an unexpected place. After the system was installed and controllable with a slick new GUI, however, the stressful alignment process that used to take half a day could repeatedly dialed in within 30 minutes. It was, as Maggie said yesterday, a deeply therapeutic experience.

Apodized beam passing through four PIAA lenses following alignment. Bottom right corner: Jared’s beautiful coronagraphAlignment GUI

After finishing my work and taking some lab-data testing the extinction of the laser source, we were ready to start buttoning up the system and getting the lab ready for the observing run in some four weeks time. While Jared and Jay developed the checklist required for the first sans-PI run in MagAO-X history, I spent a thoroughly enjoyable hour cleaning the lab and organizing the piecemeal Allen key sets that had been OCD annoyances over the past week. Although I was not successful in the dream of “every key for every set”, and although our box of misfit keys continues to grow, I hope that the next run will be able to kick off with a fresh, organized start. A big part of the run turned out to be giving MagAO-X the TLC that can be often delayed by urgent actions or on-sky timelines. Maggie did excellent work in re-routing cables to clean up chaotic areas and provide a modicum of organization to an optical bench that can otherwise appear to be bursting at the seams. Although these changes may not be obvious to someone looking at the system afresh, we hope that it will lead to better, more productive and less stressful work going forward.

Reluctantly leaving our home for the past week

[Now, a brief aside for the flora of Las Campanas Observatory]

This was a very special trip for me because I thought that, when leaving the mountain in March 2023, that I wouldn’t return to LCO after graduating. Amid the satisfaction of good progress in the work here, I have equally enjoyed seeing the mountain with new eyes. Since my last time here, I’ve learned quite a lot about native Sonoran desert plants and was very interested to see similarities with the flora of LCO. The plants here cope with even harsher conditions than Tucson, and the mountain in general is very overgrazed by marauding hordes of goats. Most drought-tolerance adaptions used by Sonoran desert plant can also be seen with the plants as Las Campanas.

I’d like to highlight one LCO plant in particular that I recognized immediately from its Tucson counterparts. This is Lycium minutifolium, literally “Tiny-leaved thornbush”, that grows around the hillsides of LCO. There is a beautiful, massive specimen that grows next to the hotel rooms we usually stay at near the lodge. We have several family members of the Lycium family around in the Sonoran desert, including L. fremontii and L. berlanderi. Their fruit is related to a gogi berry (L. chinense) and is considered a “superfood” often used as a dietary supplement. The genus is in the nightshade (tomato/potato) family. They are also beloved by a huge range of birds, who eat their fruits and take shelter in their dense thickets.

The Lycium species in Tucson have several drought-tolerant characteristics including small, fleshy leaves that drop during periods of dry weather. Although the bushes seem to be covered with thorns, these are actually leafless branches that taper to points. One of the main ways to identify species in Tucson is to “shake hands” with the plant: different species have dramatically different pointy ends and leaves. Some species that grow in less stressful conditions can feel soft to the touch.

Fruits of my favorite species, Lycium andersonii, in Tucson

By comparison, the Lycium at LCO is a thornbush on steroids. Its leaves are an order of magnitude smaller than the Sonoran desert plants, meaning that it loses less water through transpiration. Its pointy branches can basically be considered a middle finger to the world, saying “come and try to eat me”. They are incredibly sharp and strong, even compared to the unfriendly variants that grow in Arizona. Because of this, they remain one of the only bushes that keep their leaves amid the grazing pressure from goats and donkeys. All together, the plant is a very interesting reflection of the different challenges and pressures of the Chilean desert compared to the Sonoran.

Left: L. minutifolium at LCO. Right: L. pallidium at Petrified Forest National Park

Song of the day

If you only listen to one song I ever recommend on the XWCL blog, it should be this one. It comes from my favorite album of the 2010s: “Age of Adz” by Sufjan Stevens. This song is the final track on the album, it is 25 minutes long and it is a masterpiece. Listen to it when you are driving in the car. It goes through the full range of human emotion and some day I will find a party where we can dance all the way through it. I remember listening it to the first time when I was 18, driving under the St. Johns bridge in Portland and not believing that it could change musical passages yet again. I remember listening to it while driving through eastern Maryland in Fall 2019, stuck in traffic and dancing in my seat. And now, I will remember listening to it while walking up to the cleanroom at LCO, 18 minutes deep and thinking that I need to take an extra lap so that it can finish before I get back to work. I hope you might enjoy it as well.

MagAO-X Engineering Run 2024B Day 3: No-Fuss LLOWFS

Walking back in the dark with Jay tonight under quiet stars, I remarked that “even though I arrived yesterday it already feels like a week, but in a good way.” Long days can do that – leaving the cleanroom at 12:00am was pushing well into our sixteenth hour of work. Time in general though has a more, ethereal quality on top of the mountain. It can be hard to remember that life continues outside of the immediate challenges of the day, and that every day before now hasn’t been just like this one.

The main goal for today was to align the LLOWFS – this is Lyot Low Order Wavefront Sensor or “YO-FUSS” using the Spanish pronunciation. When paired with a transmissive coronagraph, rejected light from the Lyot stop provides “free” photons for driving auxiliary wavefront control. The system had been roughly assembled in Tucson and we had poetic alignment instructions as courtesy of Sebastiaan Haffert and Chat-GPT:

In the lab where lasers gleam,

Align the Lyot, chase the beam.

Turn it on, ensure the light,

Hits the center, sharp and bright.

Flip the clamps, turn them around,

Old positions, stoppers found.

Pull the wheel, the system’s grace,

Install the mirror in its place.

Put it back, a careful feat,

Center Lyot, alignment neat.

Tilt the laser, shift with care,

Card in hand, another’s stare.

Lens one’s heart, its center true,

Shim stock, tilt—just right for you.

Centering near, within a mill,

Precision holds, steady still.

Lens one now done, we move ahead,

Z filter next, where paths are led.

Remove the tube, the chip exposed,

The cap now off, the system grows.

Pivot here, or pivot there,

Camera moves with patient care.

Optical feedback, guiding hand,

Or move again, the next command.

Install the tube, frosted within,

Pinholes small where light begins.

Lens to guide, align once more,

Precision sought, forever sure.

As most alignment projects go, lived experience quickly derailed from our flowery aspirations. While Jared fought down a flurry of unexpected problems that I won’t pretend to summarize, Maggie, Jay and I slogged through the full range of alignment processes and human emotion necessary to correctly focus the reflected beam onto the LLOWFS sensor.

Busy space around the Lyot wheel: also pictured include VIS-X, PIAA + iPIAA, focal plane wheel, LLOWFS camera, scicam2, FLOWFS camera + selector stage and a heart-attack-worthy number of OAPs

The main difficulty in alignment came from the sheer number of things (I’m going to stick with “things” here because my gut reaction at the end of the day is to use a couple swear words but a lot of time went into each part) in the neighborhood around the Lyot wheel. Opening the panels this morning made me think of the frog that hops into lukewarm water and quickly finds itself boiled alive. When I started looking at PIAA designs in early 2022 this area was fairly crowded but manageable. Years later the optomechanics have grown layers deep and maneuvering a stubby Allen key through the optical jungle can take thirty seconds and Zen breathing techniques.

Using a telescoping mirror to translate the beam into the first pinhole. Once it passes through, the camera and tube assembly needs to be rotated around this pinhole to align the beam into the second pinhole

We added a mirror to the Lyot wheel to use a reflected beam for the alignment. Picomotors on the stage means that translating the wheel in x and y are quite straightforward, but using the wheel as a mirror instead of a simple aperture means that the tip and tilt in both directions became critical. The immediate descent into shim madness gave a portent of the long day in store for us.

Aside: it’s rather silly to spend much more time writing the details of our work today when it’s already late and breakfast will be served in six hours. I’m going to scatter a few photos through the post and call it sufficient. The biggest takeaway from the day though is that external challenges are always manageable with the right team around you. Despite the setbacks and technical frustrations that were part of the alignment process, problems became fun, interesting challenges when shared with the group. I appreciate doing this work on an engineering run, with no rush at night and enough time to listen to each other’s perspectives. Amid this collaboration and working in such a beautiful place, one long day makes us only more prepared for the next.

The indefatigable triumvirate: Socket Boy, Tube Man and Shim Queen

Song of the day

I had about twenty songs stuck in my head through the course of the day. When doing delicate or technical work I like to nurture their memory on repeat because I find that tends to relax the high stakes. Of the songs that I played during breaks afterwards, sitting outside the cleanroom and appreciating the warm sun, this was the only one that met the blog rule.

MagAO-X 2023A Day 10: “The second night is always the hardest one”

Astronomers are a fairly adaptable or masochistic lot. Regular switches between day and night are sought after, locations without much oxygen are prized, and network systems are designed around blocking communication with our own instruments. Observing runs are an oscillating balance between excitement and dejection, determination and delirium, and sleep and awakeness. In this world of contrasts, resilience is honed and prized. There are some times where the hardened star dust of astronomical grit wears thin, however, and this usually comes on the second night of the run. Our circadian rhythms have not yet been forced into submission yet, and the long day followed by a bewildered sleep tends to run its course by 3am. The adrenaline rush of the first milestones have passed, and we aren’t yet settled into the comfortable routine of known problems and sandwich forms.


We will pass through the fire of the transition, and are looking forward to more coherent days to come. In the meantime, I am running out of writing steam and will follow the guidelines that Eden suggested when arguing why I should write the blog tonight.

“I think that you would do such a better job. Topics Warren can put in a blog:
“Him doing PIAA stuff”


Him staring hard at PIAA stuff


Him doing random walks and taking astrophotography”

How he is leaving in two days and will miss Las Campanas


How Eden will be here for 14 more days and will have to write so many more blog posts than Eden


How much Warren cares about Eden and her mental health and how she has to stay up until sunrise”

As a group we made it through the night, and look forward to many more nights making progress and working together. See you all tomorrow.

Edit: Song of the Day

The carpool left promptly at 7am and, bleary from late night picture captions, I forgot everything about finishing blog posts with a song of the day. Tonight is filled with the nostalgia of being my last night at LCO. My fondest memories are filled with late night delirium and accomplished resolve. Laughter against the ever-present backdrop of the night keeps evoking the line:

The sunshine bores the daylights out of me
Chasing shadows, moonlight myster
y

The memorable association of this song is from walking down the mountain amid the sunrise, squinting against the growing light and looking forward to the dark nights to come.

Edit2: the lost blog post

Eden and Jay convinced me last night to finally post the blog entry that I had started for the AO summer school. It is retrodated here:

MagAO-X 2022B Day 10: Last calm before the storm

The long days spent waiting for a resolution to the trucking strike were unwanted but provided unusual tranquility on a mountain normally full of activity. Starting work yesterday morning brought welcome relief to have control back in our hands: turning wrenches and aligning optics was made sweeter by the ennui and uncertainty we had experienced waiting for our system to arrive.

It is to the credit to the group, then, that we did not trip over our own feet in excitement to have something to do, and instead an aura of calm pervaded almost all actions of the days. Like a well-rehearsed dance, our shifts in the cleanroom prepared each subsystem for integration onto the larger bench, and we were quick to characterize problems that will be addressed in days to come. The two days for preparation were unusually brief: because of time constraints we needed to run through our system characterization without incorporating the air-support mount or high-actuator count deformable mirror. Despite the outward expectation of hurriedness, we finished both days with remarks about how quickly everything had gone. Stepping outside this evening into golden sunset light with our instrument packaged and wrapped for the telescope was uniquely rewarding.

This calmness amid the bustle of activity would do well to linger into the next few days. Tomorrow will be the busiest day of the trip, loading our precious cargo onto a truck early in the morning for the final 200 meter climb to the telescope and then solving wavefront control problems through the starlit night. Today, then, was an important day to appreciate the quiet moments before the tempest that will challenge and enthrall us tomorrow.

Almost all the LCO animals joined together in making today a good day to remember. We had visits from the donkey herd:

“If we give them an apple, do you think they would give us a ride?”
These would have been great for the trucking strike

The guanacos also made a rare, close to the lodge appearance before bedding down on the hillside south of the telescopes.

Great photo, Eden
I count at least six pixels

Furthermore, our resident viscacha spent time posing for admirers:

Every single one of us wishes that we were this viscacha. Or at least that we could cuddle with this viscacha.

And certain, unnamed members of the group were hassled by menacing birds between homework assignments.

Looks can be deceiving: this bird is a killer

Inside the lab, Jared and Joseph started the day with heroic efforts to troubleshoot problems on the erstwhile moody ICC. It seems possible that problems may have originated during bumpy transport; we are all hoping that we’ll soon forget there was ever anything wrong at all.

Hardhats are always welcome but the incorrect PPE for this situation: our computers go directly for the heart

Afterwards, Eden, Sebastiaan and I each got to play with our instruments but work was hampered in part by bad PSFs caused by some combination of pupil shift and no tweeter mirror. We were glad for an online celebrity guest troubleshooting appearance from our very own Kyle van Gorkom; hopefully getting the instrument onto its air support in the telescope will restore beam paths to closer to what we had seen in Tucson.

“It works because I tell it to work”
Brief moments in the process allow us to step back and think “wow, this is really crazy”.

As quickly as it had started, it was time to pack everything up and get ready for the final ascent tomorrow. Avalon’s instincts as master plastic wrapper sprang into seasoned form, and good teamwork led to a record decabling and preparation.

This looks like a lot of plastic but Avalon only began wrapping twelve seconds before this photo was taken
Fitting into the gowning area in this cleanroom feels like squeezing into a clown car

Finally, our work finished, we enjoyed a very pleasant team bonding experience lingering outside as the evening glow turned into night. Amid the certain hubbub and work of the coming days, it was lovely to pause and appreciate the quiet stars twinkling in the night, before peering deeper to unravel their mysteries.

History will forget anachronism and assume that this sunset photo also happened tonight
“Keep looking, those aliens will show up eventually” “All of the quotes in these captions are not real”

With relief and anticipation we look forward to the busy days to come, but also look back with fondness on our unexpected, quiet days on top of the world. Time spent walking the gravel mountain roads holding dual feelings of awe and angst consistently evoked the music of Townes van Zandt, and I’d be remiss to not include a song of those moments before our nostalgia is swept away by the activity quickly upon us.

MagAO-X 2022B Day 3: An astronomer’s guide to Valparaíso, Chile

Ninety minutes west of Santiago lies the fantastical, ebullient town on Valparaíso. Known as “Valpo” to the locals, it offers endless labyrinths of hidden staircases, harbor views and consistently interesting street art. Though well ensconced in long-haul South American itineraries, it is not well-known to most traveling astronomers despite its easy access from the Santiago Airport. Because of its smaller (~400,000) size, it is a more manageable and comprehensible city than the capital, and better suited for a short trip. While we wait at the mountain for our crates to arrive, may I offer some diversion in a guide to spending a few days on the coast.

Arrival

Landing in Santiago, do your best to not notice the “2:15am” on your phone before it updates to the local time. Valparaíso is easily reached by transferring at the bus station “Pajaritos”, which is a hub on the western outskirts of Santiago. Buses run there from the airport every ten minutes, and from there towards Valpo every fifteen.

After passing through customs, the bus station is seen on the prominent map outside the terminal. What is less obvious is that you need to get there from the upper level, passing over the parking garage to a bridge connecting the station. The helpful “Turbus” company staff sell a ticket to Pajaritos for CLP1600 – about $1.75 cents. Many buses continue from Pajaritos towards Alameda – another hub station closer towards the city centro – but more than half the passengers leave at the first stop.

The greatest ambiguity comes from getting off the bus outside of the Pajaritos station. The local buses pull up to the curb outside the station, near a few booths hawking sodas and souvenirs. Walk inside the station and another Turbus booth on the immediate left sells a ticket to Valparaíso for CLP 5500 or six dollars. This is a good time to get a coffee and stop thinking about the last 18 hours of travelling.

The bus ride to Valparaíso is beautiful and passes through several Chilean wine valleys. It descends from these foothills into a coastal floodplain, where the first sight of the city comes from colorful houses dotting the hillside. The bus stops outside the National Congress building, where the bright sunshine and loud noises from produce and sweatshirt vendors can be disorienting. Depending on the distance to your hostel, there are choices to walk, take a bus or a taxi (or Uber). My plans to walk and get an initial impression of the city were quickly replaced by deeper needs for a nap and change of socks. A bit flustered about bus schedules, I recomposed with a much-needed beer which helped break a bill into coins to pay the local bus (CLP350, $0.38) with coins.

Accommodations

Valparaíso is fairly popular among the European backpacker crowd, and there are a good selection of cheap hotels and hostels accommodating budget travelers. Because of tourism mixed with a generally global perspective, a surprisingly large number of locals speak English. Accommodations are mainly centered around the hilly Concepcion neighborhood, which was the epicenter of planned street art in the 1990s. From this spot you can quickly head up any number of colorful staircases hiding interesting art and local boutiques.

I stayed at the “Hostal Po”, which was a conventional and clean hostel that featured a common space on the top floor for cooking and meeting other travelers. My private double room was CLP35000 ($38) a night; I was told that the CLP13000 ($14) dorm rooms were quite nice. The hostel was decorated by a large suite of local artists, and every room had some unique mural. At first glance, though, there was no sight more beautiful than the open window next to a made bed. Long summer hours meant that even after a luxurious nap, plenty of daylight remained for ample exploration.

Activities

Although there are several good sightseeing activities in Valparaíso, the main draw is the city itself. The best thing to do is to put away the map, step onto the street and walk down whichever street seems most interesting. Staircases are built into the hillsides where cars or horses could not travel. Originally a boomtown from shipping routes heading towards the new world, city planning was frenetic and energetic, and bright colonial houses are stacked on top of each other on the steep hills above the bay. After a lull of economic activity following the construction of the Panama Canal, the city has been largely revitalized through tourism and a vibrant art community.

An emblematic sight in the community is the “Ex Cárcel de Valparaíso” – an abandoned prison that has been transformed into a community park and arts space. Following the prison closure in the late 1990s, community activists began renovations and fought development by real estate developers. The concrete walls that used to echo with screams from torture during the Pinochet dictatorship now ring with children laughing under gardenias and bougainvillea; the cells transformed into ballet studios and hung with silks for aerial dancing.

One other classic sight is the “Casa Museo del Neruda”, where the poet lived from the 1950s-70s. Well maintained, the five-story tower is unique and tells eccentric stories amid beautiful views of the hills and harbor. Really, though, any places listed in the guidebook serve mainly as a motivation to see new hillsides, mosaiced staircases and idiosyncratic murals.

Carousel horse in Pablo Neruda’s house

Safety + nightlife

My short experiences in Chile have given the impression that the country is significantly safer than other places in South America. However, the gritty port characteristics of Valparaíso means that a decent amount of caution is warranted. The streets felt uniformly safe during the day, and were mainky filled with parents walking with their children to school, old couples stopping to chat with friends, friendly stray dogs, construction workers, etc. I was told that the area close to the port is sketchier, but safe if you don’t wave around cash or expensive cameras. The neighborhoods grew poorer as you continue climbing endless hills, with houses eventually melding into slums. These areas never felt dangerous, but did become much more abandoned and made me paranoid. A rule of thumb developed after a few U-turns is that if your street turns to dirt then you should consider turning around.

Several locals warned me about going out alone at night because of the risk of muggings and pickpockets. Although main streets are well-lit, they did seem quite risky at night. I walked back to the hostel one night in a group of three, without any troubles, but also with no motivations to linger.

Paradoxically, Valparaíso is known as a great nightlife city, especially on the weekends. Most people don’t go out until 1am. The scene on Tuesday night was quieter but still lively, and I went with a Chilean / Colombian / Belgian group from the hostel to a great live music show with two singers alternating between jazzy vocals and rap. The local hipster crowd formed groups outside on the street between sets, chatting while sipping pisco sours and making staggered visits to the corner store for cheap beers that could be smuggled back under jackets and purses.

I found the people in Valpo almost uniformly friendly, open and eager to help. The experience was a fantastic introduction to Chile and I highly recommend leaping on any possibility to visit. Total trip costs were approximately:
$16: transportation
$38/night: lodging
$2 for coffee
$8-10 for larger meals
$3-4 for museum tickets

The amount of nooks and colorful crannies was astounding, and with many more photos than could be squeezed into a blog post, I’ve made a Drive folder if anyone would care to see them.

The video for today’s post is by the two singers/rappers that I got to see on Tuesday night. The music is interesting, and they do a good job of capturing the scenes and vibes around the city.

Now, let’s get the truck up to LCO!