when i started preparing stuff for DataFrames, it seemed sensible to introduce the Python Dictionary.

in it, i use the NATO alphabet, which as we all know is an acronym. Another form of an abbreviation is an initialism. Both utilise the first letter of words to form a “new” word but the former pronounces it as a word, while the latter is voiced by each initial (like AI for Artificial Intelligence).

as part of forming the subheadings, (although often used interchangeably) i discovered if i should use duplicate or replicate.

here’s the updated repository:

https://github.com/LinsAbadia/Python/tree/master/DataStructures

I originally thought of doing both a presentation and blog post but due to time pressures opted for the latter. Here’s a concise version of what I ended up doing…

I’ve used a “structured” approach to impart more formality but being a blog post I decided to make it more “medium-friendly”.  =)

A.  Introduction

A.1 Description and Background

Since New York city had over 60 million visitors last year alone, it may be useful to recommend hotels based on their physical proximity to major attractions (such as Central Park – not Central Perk of Friends fame) or what I called Places of Interest (or POI for short)using the Haversine formula – it’s a technical way of measuring distance between points using Latitude & Longitude (I won’ bore you with the details as it uses a lot of Trigonometric functions).   Essentially, it was envisioned to help plan your trip to the Big Apple.

A.2 Data

It used “free” data to determine which hotels are in which neighbourhoods and in which boroughs (so I used an API called FourSquare to get some of the place information).  Unsurprisingly, the major hotels were clustered in and most POI were located in Manhattan.

B. Methodology

I used clustering to segment my data (thankfully, the hard bits are already implemented). Freakishly, the cluster of neighbourhoods corresponded to the NYC boroughs (you know somebody worked it out).  This was confirmed visually (after all, seeing is believing) by something called a Folium map (see below).

This is one of the “cool” tools available at your disposal.  This is not, in and of itself, conclusive proof but you can “go down a deep rabbit hole” of data to assert your claim.  This is, by no means, the only “weapon” available to you but it sure is pretty.

C. Results

Unremarkably, the data merely confirmed what we’ve always known:  hotels are near one another and sites are chosen for their proximity to popular landmarks and sought after amenities – it’s so obvious, duh.

D. Discussion

It’s not always about generating new insights.  It’s sometimes about “empirical”  confirmation of things we just take for granted as true.

E. Conclusion

I can talk until I’m blue in the face but you’ll probably pay me no mind and tune out (if you haven’t already). In short you can use Data Science (and its associated tools) can be powerful in uncovering secrets.

If you’d like to read a more detailed and “serious” document, the full  report can be dowloaded at

https://github.com/LinsAbadia/corsera/blob/master/ADSC_Report.pdf

If code is more your thing, a Jupyter notebook in Python can be obtained from:

https://github.com/LinsAbadia/corsera/blob/master/ADSC_Finalv7.ipynb

If you’re generally more interested in GitHub (and open source computing), you can go to the following address:

https://github.com/

This has mainly been about content but, in my experience, context can be just as, if not more, important – that’s how you should think about Data Science!

it wasn’t an “ugly cry” but I even surprised myself with involuntary tears and noises despite being cold-hearted – my “excuse” is my age and my ABI.  Maybe it was a combination of my wife finally expressing her true feelings (as she was busy making arrangements ) and seeing my mother-in-law (for the first time and the stark realisation dawning on me).

it’s hard not to talk about somebody else and make it about you but everything’s relative and according to your personal viewpoint – this is an entry in my blog after all.  It’s often difficult to pay “tribute” without getting any reflected light upon yourself – I’ll try to cast as small a “footprint” as possible.

i’ve always subscribed to the concept that memorials are for the benefit of those left behind.  We grieve at our loss and how our lives are less now- and sometimes fail to celebrate that the person has moved on.  Understandably,  we are just human and it is natural to feel this way but it is sometimes subject to a tinge of “selfishness”.

i think it’s rather apt that this goes out on the feast day of  St. Augustine.  i do agree that the Bishop of Hippo’s life be celebrated but “most” overlook the importance of St. Monica, his mother. And how hidden figures can be “forgotten” by history.

My mother-in law was selfless, kind, patient, understanding, amongst other things.  She had her faults, don’t get me wrong but the positives vastly outweighed the negatives.   Her penchant for not complaining about pain or discomfort was, ironically, part of her undoing.

i ran across an article  (

) recently why we hold certain people in high regard.  i argue that selflessness is an extreme form of humility.  she might have not seem intellectually curious but I suspect she was simply a product of her generation when most women were relegated to domestic duties. Perhaps, it would have been more developed under different circumstances – she did, after all, “painstakingly” tutor my wife and niece, both of whom excelled academically, and, given the opportunity, would have liked to become a teacher.

As a sign of her uttermost empathy, although she was in extreme pain, she asked about our family’s laundry situation.  That was quintessentially her.  I, guess, that was one way of externalising her love aside from cooking.

She would have not liked me making a fuss because of her but I don’t know any other way but to share her name: Lucila Legaspi Reyes.

Words are just words.  Sometimes words are not enough – this is one such instance.

there appears to be a tendency of social media to focus solely on the good – there’a a plethora of “humble” brags and “unrealistic” posts.  i’m obviously not a big fan but i can understand why it’s worth it “following” certain people.  Don’t get me wrong – i’m all for democratisation and giving a voice to the traditionally voiceless but a lot of it is to me vacuous and inane palava (or palaver if you prefer) – not to mention the trolling and glaring divide.  i worked in ICT for a number of years prior to my ABI (Acquired Brain Injury):  technology can be a magnifier for “bad” and  not just a multiplier for “good” – in my experience, it’s a double-edged sword.  i believe posts shouldn’t be policed or censored (free speech and all) but people should be better equipped to discern the “wheat from the chaff” – a form of “natural selection” of sorts (if you will).  It would benefit from balance (like most things in life).

part of this is “processing”.  Some of it is “snobbery” (i’m only human after all).  That said, take from it what you will – i’m not narcissistic enough to discount any “unintended interpretations” of my writing.  My only caveat that it is partly out of need (and partly due to therapy) so it might not be most people’s “cup of tea”.

there’s undeniably some “good” occurrences recently.  Firstly, i’m nearly halfway in completing my online certificate in data science.  This will, “hopefully”, help me get into “gainful” employment again after being “sidelined in the wilderness” for over a decade now.  At times, I used to work a part-time job along with a full-time one – so being homebound was a “drastic” change.

over the last two weeks, i’ve been finishing online crosswords daily. It started with 2.5 hours but now i’m down to a little over 50 minutes usually and my best time is approximately 38 minutes.  i’m merely an amateur cruciverbalist who wants to improve and build up to something challenging like the New York Times Sunday crossword.

i’ve had no falls over the last several months despite my last two  SARA (short for the Scale for the Assessment  and Rating of Ataxia) tests showing slight deterioration.    i think this is mainly due to my neuro PTs’ advised interventions added to (or slightly modifying ) my daily exercise routine.  Sure the NDIS (Australian National Disability Insurance Scheme in case you’re not aware) is a source of much consternation and a bugbear to negotiate (even for mundane tasks) but thanks to it i can now afford to go weekly instead of monthly (which used to be the case).  I had several near-misses lately:  the point is I didn’t fall down where a couple of months ago i surely would have.  As in everything there is both good and bad – i’ve heard it referred as a major reform since MediCare:  there are obvious, signficant “teething problems” with its initial rollout but you can’t really fault the intention (it is the implementation where it falls down – pun intended ).

sadly, i’ve been binge watching a lot lately. Whether to “empty out” the numerous recordings on my DVR (Digital Video Recorder) or streaming over the Internet – i’m such a cheapskate that I only use free services (thankfully, Australia is quite “progressive”).  My  current darling is  “You’re the Worst” on SBS (Special Broadcasting Service) On Demand – the “Resume” function makes the bugs bearable.  I watched all episodes of the four seasons available on the web. I find the writing witty and funny (admittedly, i’ve got a “dark” sense of humour i liked the tv show Legit , i found the movie Pulp Fiction hilarious, and mostly laughed throughout the stage show, The Book of Mormon ). I enjoyed Seasons  1-3 ; S4 was ok (my “disappointment” with the new intro notwithstanding) and still will watch the last season (i’m curious how they will wind it down and then end it). i think Ricky Gervais was right to cap the UK  version of The Office after two series.  i use TV to distract from the thinking i do during the day – so “smart” and “subconscious” programming is much appreciated.  The last show made me think of the novel, The Unbearable Lightness of Being although watching is supposed to relax me.  i sometimes read (with the aid of a magnifier) during ad breaks (i know this is counter to my intent but i can’t really help doing it).  i find it helps me think more broadly about things and i’m not limited to seeing things only in a certain way.

My Ph.D. has stalled and as of late i rarely write anything – and when i do i only mange a few words.  Maybe i’ve just “hit the wall” and i’m just tired given the number of years (when a lot of things usually pique my interest) and the effort to type compounded by my waning interest.  Maybe it’s not up to scratch given my exacting standards and past performances.  Maybe it’s my growing frustration with the admin required and my over reliance on altruism upon learning the hard way that it’s self-interest that often yields results.  Maybe it’s my substantially increased anxiety due to my health concerns or fast approaching conclusion of my candidature.  i suspect all of these factors play a role.  Thankfully i’ve got a supervisor who believes in me and my abilities – she’s doing what she can to make that path is still available to me.

i was told that walking outside would do some good – not only would it further develop my legs given a functional task but it would also expose me to fresh air and vitamin D.  I’m trying to incorporate this into my routine but admittedly i’m hesitant given my bouts with hay fever and uneven terrain and inclines.  On days when the pollen count is not too high, I go outside the front of our house to gradually acclimatise me to the irritants and eventually build enough strength to confidently tackle going around the block.

My speech difficulties have taught me to listen more to others.  My walking challenges have resulted in me losing weight (as the heavier i am, the harder it is to remain ambulant), made me appreciate more the challenge of getting robots to balance on two legs.  My greatly reduced typing speed has caused me to concentrate more on quality rather than quantity. As has happened in the past with other persons with disabilities, it has ‘forced’ me to adapt and strategise to perform common tasks.

It is easy for me to continue being negative: seeing silver linings does not come natural.  These are the cards i have been dealt and need to make the most out of them.  Admittedly, it still pisses me off when people whinge about what i consider to be “terminally trivial” things but i have to learn to focus instead on the things i need to do and how i can perform them better.  While the Chinese symbol for ‘crisis’ has been disproven to mean both ‘danger’ and ‘opportunity’ simultaneously, it is still useful to see both the  yin and  yang of things.

2 princes

June 6, 2018

sorry. i was MIA but I had a few personal issues to contend with. I’m sort of back.  That said, my posts will be “irregular” over the next few months.  I need to reserve most of my time and effort for my other blog for my studies.  You may wonder why I maintain two.  It’s because most of the ideas there are not yet ready-for-prime-time and aren’t up-to-snuff  yet to be shared.

It’s partly a quality kick but mainly because you can’t serve two masters well.

born to run

November 24, 2017

PBS Newshour showed again Part 1 of Jeffrey Brown‘s interview with Bruce Springsteen (originally aired December 19, 2016; the video url: https://www.pbs.org/newshour/show/bruce-springsteen-tackles-truth-song-memoir ). It was meant to be a promo of his memoir but it was much more to me.

He might not be my favourite artist or a technical singer but like he says: he’s learned to ‘inhabit his songs’ which makes his songs more believable.  Moreover, his working-class roots makes him seem authentic and relatable. I don’t pretend to be an expert on him (or his numerous works) but it wasn’t until I heard the original acoustic (and much more slower) version of ‘Born in the USA’ that I thought I understood the lyrics and what that song was truly about.

As he says in his interview and his in his new memoir “I wasn’t modest in the assessment of my abilities. Of course, I thought I was a phony (sic). That is the way of the artist. But I also thought I was the realest thing you had ever seen.” It’s about dichotomy, I guess – existing on two different planes at the same time.  For me, a real artist lives (and exists) with contradictions – they are only human after all.

You can watch Part 2 at https://www.pbs.org/newshour/show/music-medicine-bruce-springsteen

almost famous

November 13, 2017

the other night I saw the 2015 dramatic film: “The End of the Tour” on SBS.  I wasn’t sure I was going to like it – it was essentially a conversation and given it’s difficult as medium skews heavily toward being visual- but I really enjoyed it.  It was an interview over several days by David Lipsky representing Rolling Stone magazine about the critically-acclaimed author David Foster Wallace (I must confess whose name I hadn’t heard before).

I found that actors cast, Jason Segel (for Wallace) and Jesse Eisenberg (for Lipsky) were well-thought choices.  They were both “smart” enough that neither performance seemed “wooden” (suffice it to say it wasn’t an enormous stretch to suspend disbelief).   This can be “tricky” given it was a mainly dialogue-driven plot.

Aside from the words, I think what drew me in was the shared “addiction” of watching too much television.  Moreover, I can relate to wanting a job where not too much thinking is required (as a respite of sorts) – it reminded me of a friend that once said that a “mindless” task was a welcome break for her from her usual job.  Furthermore, I liked that within it was featured an action movie that didn’t require a whole lot of mental horsepower to enjoy (to what I viewed as juxtaposition when the characters watched a black-and-white film on tv).

I found the scene meaningful when the proponents couldn’t find where they parked their rental car in the airport.  This just illustrates how there are different kinds of smarts and how book-smarts is not always preferable in accomplishing certain everyday tasks.  As the adage goes:  Common Sense is not that common.  This is a moment of levity that cuts the seriousness of an otherwise dry account.

I enjoyed the line:  “Nice but not real.” How some situations are artificial – one doesn’t have to look far for the often fabricated constructs of reality tv.  Don’t get me wrong; I’m not hating on the entire genre but, like all “entertainment”, some shows are more “watchable” given the individual’s purpose.

I’m now curios about Wallace’s opus of a novel:  Infinite Jest and Lipsky’s best-selling memoir: Although Of Course You End Up Becoming Yourself. Hopefully, I’ll eventually have time to read them.