Tag Archives: AI

Will AI tools based on large language models (LLMs) become as smart or smarter than us?

With the success and growth of tools like ChatGPT, some are speculating that the current AI could lead us to a point where AI is as smart if not smarter than us. Sounds ominous.

When considering such ominous thoughts, it’s important to step back and remember that Large Language Model (LLM) are tools based in whole or in part on machine learning technology. Despite their sophistication, they still suffer from the same limitations that other machine learning technologies suffer, namely:

    • bias
    • explainability
    • overfitting
    • learning the wrong lessons
    • brittleness

There are more problems than those for specific tools like ChatGPT, as Gary Marcus outlines here:

  • the need for retraining to get up to date
  • lack of truthfulness
  • lack of reliability
  • it may be getting worse due to data contamination (Garbage in, garbage out)

It’s hard to know if current AI technology will overcome these limitations. It’s especially hard to know when orgs like OpenAI do this.

My belief is these tools will hit a peak soon and level off or start to decline. They won’t get as smart or smarter than us. Not in their current form. But that’s based on a general set of experiences I’ve acquired from being in IT for so long. I can’t say for certain.

Remain calm. That’s my best bit of advice I have so far. Don’t let the chattering class get you fearful. In the meanwhile, check out the links provided here. Education is the antidote to fear.

Advertisement

Are AI and ChatGPT the same thing?

Reading about all the amazing things done by the current AI might lead you to think that: AI = ChatGPT (or DALL-E, or whatever people like OpenAI are working on). It’s true, it is currently considered AI,  but there is more to AI than that.

As this piece explains, How ChatGPT Works: The Model Behind The Bot:

ChatGPT is an extrapolation of a class of machine learning Natural Language Processing models known as Large Language Model (LLMs).

Like ChatGPT, many of the current and successful AI tools are examples of machine learning. And while machine learning is powerful, it is just part of AI, as this diagram nicely shows:

To get an idea of just how varied and complex the field of artificial intelligence is, just take a glance at this outline of AI. As you can see, AI incorporates a wide range of topics and includes many different forms of technology. Machine learning is just part of it. So ChatGPT is AI, but AI is more than ChatGPT.

Something to keep in mind when fans and hypesters of the latest AI technology make it seem like there’s nothing more to the field of AI than that.

What is AI Winter all about and why do people who’ve worked in AI tend to talk about it?

It might surprise people, but work in AI has been going on for some time. In fact it started as early as the mid-1950s. In the 50s until the 70s, “computers were solving algebra word problems, proving theorems in geometry and learning to speak English”. They were nothing like OpenAI’s ChatGPT, but they were impressive in their own way. Just like now, people were thinking the sky’s the limit.

Then three things happened: the first AI winter from 1974 until 1980, the boom years from 1980-1987, and then the next AI winter from 1987-1993. I was swept up in the second AI winter, and like the first one, there was a combination of hitting a wall in terms of what the technology could do followed by a drying up of funding.

During the boom times it seemed like there would be no stopping AI and it would eventually be able to do everything humans can do and more. It feels that way now with the current AI boom. People like OpenAI and others are saying the sky’s the limit and nothing is impossible. But just like in the previous boom eras, I think the current AI boom will hit a wall with the technology (we are seeing some of it already). At that point we may see a reduction in funding from companies like Microsoft and Google and more (just like how we are seeing a drawback from them on voice recognition technology like Alexa and Siri).

So yes, the current AI technology is exciting. And yes, it seems like there is no end to what it can do. But I think we will get another AI winter sooner than later, and during this time work will continue in the AI space but you’ll no longer be reading news about it daily. The AI effect will also occur and the work being done by people like OpenAI will just get incorporated into the everyday tools we use, just like autocorrect and image recognition is no just something we take for granted.

P.S. If you are interested in the history of the second AI winter, this piece is good.

What is the AI effect and why should you care?

Since there is so much talk about AI now, I think it is good for people to be familiar with some key ideas concerning AI. One of these is the AI effect. The cool AI you are using now, be it ChatGPT or DALL-E or something else, will eventually get incorporated into some commonplace piece of IT and you won’t even think much of it. You certainly won’t be reading about it everywhere. If anything you and I will complain about it, much like we complain about autocorrect.

So what is the AI Effect? As Wikipedia explains:

The AI effect” is that line of thinking, the tendency to redefine AI to mean: “AI is anything that has not been done yet.” This is the common public misperception, that as soon as AI successfully solves a problem, that solution method is no longer within the domain of AI. Geist credits John McCarthy giving this phenomenon its name, the “AI effect”.

McCorduck calls it an “odd paradox” that “practical AI successes, computational programs that actually achieved intelligent behavior, were soon assimilated into whatever application domain they were found to be useful in, and became silent partners alongside other problem-solving approaches, which left AI researchers to deal only with the ‘failures’, the tough nuts that couldn’t yet be cracked.”[5]

It’s true. Many things over the years that were once thought of as AI are now considered simply software or hardware, if we even think of them at all.  Whether it is winning at chess, recognizing your voice, or recognizing text in an images, these things are commonplace now, but were lofty goals for AI researchers once.

The AI effect is a key idea to keep in mind when people are hyping any new AI as the thing that will change everything. If the new AI becomes useful, we will likely stop thinking it is AI.

For more on the topic, see: AI effect – Wikipedia

No, prompt engineering is not going to become a hot job. Let a former knowledge engineer explain

With the rise of AI, LLMs, ChatGPT and more, a new skill has risen. The skill involves knowing how to construct prompts for the AI software in such a way that you get an optimal result. This has led to a number of people to start saying things like this: prompt engineers is the next big job. I am here to say this is wrong. Let me explain.

I was heavily into AI in the late 20th century, just before the last AI winter. One of the hot jobs at that time was going to be knowledge engineer (KE). A big part of AI then was the development of expert systems, and the job of the KE was to take the the expertise of someone and translate it into rules that the expert system could use to make decisions. Among other things, part of my role was to be a KE.

So what happened? Well, first off, AI winter happened. People stopped developing expert systems and went and took on other roles.  Ironically, rules engines (essentially expert systems) did come back, but all the hype surrounding them was gone, and the role of KE was gone too. It wasn’t needed. A business analyst can just as easily determine what the rules are and then have a technical specialist store that in the rules engine.

Assuming tools like ChatGPT were to last, I would expect the creation of prompts for it to be taken on by business analysts and technical specialist. Business as usual, in other words. No need for a “prompt engineer”.

Also, you should not assume things like ChatGPT will last. How these tools work is highly volatile; they are not well structured things like programming languages or SQL queries. The prompts that worked on them last week may result in nothing a week later. Furthermore, there are so many problems with the new AI that I could easily see them falling into a new AI winter in the next few years.

So, no, I don’t think Prompt Engineering is a thing that will last. If you want to update your resume to say Prompt Engineer after you’ve hacked around with one of the current AI tools out there, knock yourself out. Just don’t get too far ahead of yourself and think there is going to be a career path there.

Fake beaches! Fake lawyers! ChatGPT! and more (what I find interesting in AI, Feb 2023)


There is so much being written about AI that I decided to blog about it separately from other tech. Plus AI is so much more than just tech. It touches on education, art, the law, medicine…pretty much anything you can think of. Let me show you.

Education: there’s been lots said about how students can (are?) using ChatGPT to cheat on tests. This piece argues that this is a good time to reassess education as a result. Meanwhile, this Princeton Student built GPTZero to detect AI-written essays, so I suspect some people will also just want to crack down on the use of AI. Will that stop the use of AI? I doubt it. Already companies like Microsoft are looking to add AI technology to software like Word. Expect AI to flood and overwhelm education, just like calculators once did.

Art: artists have been adversely affected by AI for awhile. Some artists decided to rise up against it by creating anti-AI protest work. You can read about that, here. It’s tough for artists to push back on AI abuses: they don’t have enough clout. One org that will not have a problem with clout is Getty Images. They’ve already started to fight back against AI with a lawsuit. Good.

Is AI doing art a bad thing? I’ve read many people saying it will cause illustrators and other professional artists to lose their jobs. Austin Kleon has an interesting take on that. I think he is missing the point for some artists, but it’s worth reading.

Work: beside artists losing their jobs, others could as well. The NYPost did a piece on how ChatGPT could make this list of jobs obsolete . That may be shocking to some, but for people like me who have been in IT for some time, it’s just a fact that technology takes away work. Many of us embrace that, so that when AI tools come along and do coding, we say “Yay!”. In my experience, humans just move on to provide business value in different ways.

The law: one place I wish people would be more cautious with using AI is in the law. For instance, we had this happen: an AI robot lawyer was set to argue in court. Real lawyers shut it down. I get it: lawyers are expensive and AI can help some people, but that’s not the way to do it. Another example is this, where you have AI generating wills. Needless to say, it has a way to go.  An even worse example: Developers Created AI to Generate Police Sketches. Experts Are Horrified. Police are often the worse abusers of AI and other technology, sadly.

Medicine: AI can help with medicine, as this shows. Again, like the law, doctors need to be careful. But that seems more promising.

The future and the present: if you want an idea of where AI is going, I recommend this piece in technologyreview and this piece in WaPo.

Meanwhile in the present Microsoft and Google will be battling it out in this year. Microsoft is in the lead so far, but reading this, I am reminded of the many pitfalls ahead: Microsoft’s new AI Prometheus didn’t want to talk about the Holocaust. Yikes. As for Google, reading this blogpost of theirs on new AI tool Bard had me thinking it would be a contender. Instead it was such a debacle even Googlers were complaining about it! I am sure they will get it right, but holy smokes.

Finally: this what AI thinks about Toronto. Ha! As for that beach I mentioned, you will want to read here:  This beach does not exist.

(Image above: ChatGPT logo from Wikipedia)

 

Some very good thoughts (especially at the end) and the usual ramblings on a new year (i.e. the January 2023 edition of my not-a-newsletter newsletter)

We finally closed the book on another pandemic year (2022), and have moved through the first month of 2023. Yay for us!  Is 2023 going to be a pandemic year as well? An endemic year perhaps? We don’t know. One thing for sure: compared to last January, this one has been much gentler.

I think in some ways 2023 may be a transition year. We continue to have transitions when it comes to COVID. We still have new variants like the Kraken (XBB.1.5) that has surged to 40.5% of all infections and rises in hospitalizations. But we take that as a matter of course now. Indeed, there is talk of having annual COVID and flu vaccines. COVID may be more serious than the flu in terms of illness and death, but we may end up approaching them in the same way. No one talks much of flu deaths, and perhaps other than places like Nova Scotia, no one will talk about COVID deaths either. For example, in my province of Ontario it is relatively easy to track hospitalizations related to COVID: it’s relatively hard to report on deaths.

I know because I still have been reporting on COVID hospitalizations every week on twitter for months. My last update was this one:

As I tweeted, the numbers have been dropping recently. Even the ICU numbers, which shot up due to the tripledemic, have declined as the tripledemic declined. Thank god: the pediatric ICUs in November were over 100% full for a time.

So we are transitioning in a positive direction. Good. And not just with COVID.  Everywhere you see spike graphs, like this one for unemployment:

To this one for inflation:

My expectation is that the annual inflation rate will continue to transition and decline in 2023, and interest rates will follow them. That is not to diminish the impact that inflation has had so far. Things have reached the point where people are stealing food and law firms are promising to defend them for free. That said, many, including the New York Times, expect inflation to cool this year. Perhaps it will drop back to where it used to be (i.e. below 3%). If you are skeptical, I recommend this piece in VOX.

Unlike COVID or inflation, not everything has the prospect of improving in 2023. Guns in the US  continue to be a major problem. There is no end in sight for the war in the Ukraine NATO is still supportive and continues to send weapons, although it seems like Zelenskyy had to clear the decks before that occurred. As for cryptocurrencies, it may not be a year of recovery for them as the trial of SBF and FTX unfolds. But who knows: maybe this rally will be a difference.

I suspect crypto will stay dormant for many reasons. One big reason is that tech is going to change its focus from Web3 to AI. Sorry Web3. (Sorry metaverse for that matter!) Microsoft alone is spending billions on it. AI will be all anyone will talk about this year. (No one knew what to do with crypto, save techies and rich people flogging NFTs. Everyone I know seems to be using ChatGPT and the like. That’s a key difference). I’ll be writing more about AI in standalone posts in 2023, there will be so much going on.

In 2023 I expect a continuation of the trend of people flooding back into cities after having left them, based on data like this: Annual demographic estimates census metropolitan areas and census. While residences have become scarce (and rents have become high) as a result, people have not been flooding back into offices. So much so that places like NYC are looking to convert office spaces to residential spaces. The problem with the pandemic is that the changes it has forced on society are more rapid than social systems can respond. But respond they will.

Then again, a new surge could reoccur in China. If that occurs, all bets are off. For now my bets are staying on the table.

Finally, thanks for reading this and anything else you read on this blog recently. I appreciate it. I am optimistic for 2023 in many ways. I hope you are too.

Keep wearing your masks when advisable. Get vaxxed to the max.  Try not to pay attention to Elon Musk or the fate of Twitter: that will all play out in due course. Don’t get too hung up about what AI is going to do: that will all play out as well. Continue to read newsletters. Watch streaming. Listen to podcasts. Most importantly: get out and about whenever you can.

There will always be bad people in the world, and bad acts occurring. Do what you can to prevent that from happening, but don’t rob yourself of your capacity for joy as a result. Be a happy warrior on the side of good. Joy is your armour.

Never forget: you have lived and possibly thrived through some of the most dramatically difficult times in history.  You deserve better times ahead.

Enjoy yourself. Live your life robustly. Whenever you feel lethargic, think back to those times of being locked down and unable to even go to a park and sit down.  Let’s go and get it. Here’s to a better year ahead. We are counting on you, 2023.

Sorry robots: no one is afraid of YOU any more. Now everyone is freaking out about AI instead


It seems weird to think there are trends when it comes to fearing technology. But thinking about it, there seems to be. For awhile my sources of information kept providing me stories of how fearful robots were. Recently that has shifted, and the focus moved to how fearful AI is. Fearing robots is no longer trendy.

Well, trendy or not, here are some stories about robots that have had people concerned. If you have any energy left from being fearful of AI, I recommend them. 🙂

The fact that a city is even contemplating this is worrying:  San Francisco Supervisors Vote To Allow Killer Robots. Relatedly,Boston Dynamics pledges not to weaponize its robots.

Not that robots need weapons to be dangerous, as this showed: chess robot breaks childs finger russia tournament. I mean who worries about a “chess robot”??

Robots can harm in other ways, as this story on training robots to be racist and sexist showed.

Ok, not all the robot stories were frightening. These three are more just of interest:

This was a good story on sewer pipe inspection that uses cable-tethered robots. I approve this use of robots, though there are some limitations.

I am not quite a fan of this development:  Your Next Airport Meal May Be Delivered By Robot. I can just see these getting in the way and making airports that much harder to get around.

Finally, here’s a  327 Square Foot Apartment With 5 Rooms Thanks to Robot Furniture. Robot furniture: what will they think of next?

(Image is of the sewer pipe inspection robot.)

 

2022 is done. Thoughts and rambling on the last 365 days (i.e. the December 2022 edition)

Another year over. A semi-pandemic year, in a sense. Covid is still with us, but we did not (so far) get slammed with a bad new variant like we did last year with Omicron. Instead the pandemic is lesser than it was, but greater than the flu in terms of the sickness and death it brings. We still get vaccinated, though less than before. Schools are attended (though  affected),  restaurants are dined in, parties and special events are attended.

You could say things look….normal. But then you can look towards China: they seem to be struggling to deal with COVID lately. Who knows what 2023 will bring? More normal or more like China?

But that’s for 2023. As for last year and what was trending, we can look to  Google which has all its data. One place that was trending alot in 2022: China. China is struggling with both Covid and Xi’s approach to it, as this shows. As for the Chinese leader himself, it was a bad year for Xi, as well as Putin and other global bad guys, sez VOX. And it’s not just the Chinese residents that are having to deal with Xi and his government: Canada has been investigating chinese police stations in Canada. More on that here. I expect China will also trend in 2023. Let’s hope for better reasons.

Other trending events in 2022? Crypto. There was lots of talk about it and people like Sam Bankman-Fried after the collapse of his crypto currency exchange and subsequent arrest. We had stories like this: How I turned $15 000 into $1.2m during the pandemic and then lost it all. Tragic. The overall collapse of the industry has lead to things like bans on crypto mining. That’s good. It has lead to questions around the fundamentals, like: Blockchains What Are They Good For? Last, to keep track of all the shenanigans, I recommend this site: Web3 is Going Just Great. I expect crypto to remain a shambles next year. Time and money will tell.

Elon Musk also managed to trend quite often due to his take over of Twitter and more. He still has fans, but many are disillusioned. After all, his campaign to win back Twitter Advertisers isn’t going well. He was outright booed on stage with Dave Chapelle. (No doubt being a jerk contributed to this.) Tesla stock is tanking. Even his  Starlink is losing money. What a year of failure. I can’t see his 2023 improving either. Hard to believe he was Time’s Man of the Year in 2021!

Because of Musk, people are looking to join other networks, like Mastodon. (BTW, here’s some help on How to Make a Mastodon Account and Join the Fediverse). Some are looking to old networks, like this: the case for returning to tumblr. Some are looking at new ways to socialize online, like this.

Musk was not alone in trending this year due to being a bad guy. Let’s not forget that Kanye West trended as well due to his freakish behavior and antisemitism.

AI was another big trend this year, with things like ChatGPT and stable diffusion (here’s how you can set it up on AWS). We also had stories like this: Madison Square Garden Uses Facial Recognition to Ban Its Owner’s Enemies. Not good. What’s next for AI?  This takes a look. I think we may get an AI winter, but we have 12 months to see if that holds true.

For what it’s worth, Newsletters like Matt Yglesias’s are still going strong, though levelling off I think.

Trends and development aside, here’s some other topics I found interesting and worth being up to close the year:

Assisted death was a grim topic in 2022 in Canada. I remain glued to stories like this: We’re all implicated in Michael Fraser;s decision to die, and  this and this. It all seems like a failure, although this argues that assisted dying is working.

Here’s two good pieces on homelessness Did Billions in Spending Make a Dent in Homelessness? And ‘It’s a sin that we all had to leave’: Moving out of Meagher Park.

Need some advice for the new year? Try this: How Much and Where Are You Really Supposed to Tip? Consider this a good approach to  reading. Here’s a good approach to  slowing down, while here’s a good discussion on  Boundaries. Things to avoid:  the biggest wastes of time we regret when we get older.

Things I found interesting in sports this year:

Things I found interesting in general this year:

Finally, here’s some good advice to close out the year: Don’t Treat Your Life as a Project.

Thanks for reading this and anything else you read on this blog in 2022. I appreciate it. I managed to blog about roughly 3000 things on the internet this year. I hope you found some of them useful.

Happy New Year!

The rise and fall of Alexa and the possibility of a new A.I. winter

I recall reading this piece (What Would Alexa Do?) by Tim O’Reilly in 2016 and thinking, “wow, Alexa is really something! ” Six years later we know what Alexa would do: Alexa would kick the bucket (according to this:  Hey Alexa Are You There? ) I confess I was surprised by its upcoming demise as much as I was surprised by its ascendence.

Since reading about the fall of Alexa, I’ve looked at the new AI in a different and harsher light. So while people like Kevin Roose can write about the brilliance and weirdness of ChatGPT in The New York Times, I cannot stop wondering about the fact that as ChatGPT hits one Million users, it’s costs are eye-watering. (Someone mentioned a figure of $3M in cloud costs / day.) if that keeps up, ChatGPT may join Alexa.

So cost is one big problem the current AI has. Another is the ripping off of other people’s data. Yes, the new image generators by companies like OpenAI are cool, but they’re cool because they take art from human creators and use it as input. I guess it’s nice that some of these companies are now letting artists opt out, but it may already be too late for that.

Cost and theft are not the only problems. A third problem is garbage output. For example, this is an image generated by  Dall-E according to The Verge:

It’s garbage. DALL-E knows how to use visual elements of Vermeer without understanding anything about why Vermeer is great. As for ChatGPT, it easily turns into a bullshit generator, according to this good piece by Clive Thompson.

To summarize: bad input (stolen data), bad processing (expensive), bad output (bullshit and garbage). It’s all adds up, and not in a good way for the latest wunderkinds of AI.

But perhaps I am being too harsh. Perhaps these problems will be resolved. This piece leans in that direction. Perhaps Silicon Valley can make it work.

Or maybe we will have another AI Winter.….If you mix a recession in with the other three problems I mentioned, plus the overall decline in the reputation of Silicon Valley, a second wintry period is a possibility. Speaking just for myself, I would not mind.

The last AI winter swept away so much unnecessary tech (remember LISP machines?) and freed up lots of smart people to go on to work on other technologies, such as networking. The result was tremendous increases in the use of networks, leading to the common acceptance and use of the Internet and the Web. We’d be lucky to have such a repeat.

Hey Alexa, what will be the outcome?

UGC (user generated content) is a sucker’s game. We should resolve to be less suckers in 2023

I started to think of UGC when I read that tweet last night.

We don’t talk about UGC much anymore. We take it for granted since it is so ubiquitous. Any time we use social media we are creating UGC. But it’s not limited to site like Twitter or Instagram. Web site like Behance and GitHub are also repositories of UGC. Even Google Docs and Spotify are ways for people to generate content (a spreadsheet is UGC for Google to mine, just like a playlist is.)

When platforms came along for us to post our words and images, we embraced them. Even when we knew they were being exploited for advertising, many of us shrugged and accepted it as a deal: we get free platforms in exchange for our attention and content.

Recently though it’s gotten more exploitive. Companies like OpenAI and others are scrapping all our UGC from the web and turning it into data sets. Facial recognition software is turning our selfies into ways to track us. Never mind all the listening devices we let into our houses (“Hey Google, are you recording all my comings and goings?”…probably)

Given that, we should resolve to be smarter about our UGC in 2023. Always consider what you are sharing, and find ways to limit it if you can. Indeed give yourself some boundaries so that when the next company comes along with vowel problems (looking at you, Trackt) and asks for our data, we say no thanks.

We can’t stop companies from taking advantage of the things we share. So let’s aim to share things wisely and in a limited way.

It’s Sunday. Here are nine pieces to mull over this afternoon.

Sure you can make yourself busy on this warm summer weekend. Or you can chill for a bit and read one of these thoughtful pieces. I know which one I am going to do. 🙂

  1. Here’s a piece on the joy of Latin. Really.
  2. 100% this: The Case for Killing the Trolley Problem
  3. Worthwhile: Piketty on equality.
  4. This is a weak piece that tries to link AI to colonialism but fails to make the case:  AI colonialism.
  5. Do you have siblings? Read this:  How Your Siblings Can Make You Happier.
  6. Worth chewing on:The limits of forgiveness.
  7. On one of our oldest technologies: the importance of wood .
  8. Dive into this list of common misconceptions.
  9. Finally, this piece on  Alexa with the voice of dead people will get you thinking.

Computer memory isn’t our memory and AI isn’t our intelligence


Since the beginning of the digital age, we have referred to quickly retrievable computer storage as “memory”. It has some resemblance to memory, but it has none of the complexity of our memories and how they work. If you talked to most people about this, I don’t think there would be many who would think they are the same.

Artificial Intelligence isn’t our Intelligence, regardless of how good it gets. AI is going to have some resemblance to our intelligence, but it has none of the complexity of our intelligence and how it works. Yet you can talk to many who think that over time they will become the same.

I was thinking about that last week after the kerfuffle from the Google engineer who exclaimed their software was sentient. Many many think pieces have been written about it; I think this one is the best I read from a lay person’s perspective. If you are concerned about it or simply intrigued, read that. It’s a bit harsh on Turing’s test, but I think overall it’s worth your time.

It is impressive what leaps information technology is making. But however much it resembles us as humans, it is not human. It will not have our memories. It will not have our intelligence. It will not have the qualities that make us human, any more than a scarecrow does.

Today in good robots: reforesting drones


I’m often critical of robots and their relatives here, but these particular drones seem very good indeed. As that linked article explains:

swarms of (theese) seed-firing drones … are planting 40,000 trees a day to fight deforestation…(their) novel technology combines artificial intelligence with specially designed proprietary seed pods that can be fired into the ground from high in the sky. The firm claims that it performs 25 times faster and 80 percent cheaper compared to traditional seed-planting methodologies.

I am sure there is still a role for humans in reforestation, but the faster and cheaper it can be done, the better. A good use of technology.

You cannot learn anything from AI technology that makes moral judgements. Do this instead

books
Apparently…

Researchers at an artificial intelligence lab in Seattle called the Allen Institute for AI unveiled new technology last month that was designed to make moral judgments. They called it Delphi, after the religious oracle consulted by the ancient Greeks. Anyone could visit the Delphi website and ask for an ethical decree.

What can I say? Well, for one thing, I am embarrassed for my profession that anyone takes that system seriously. It’s a joke. Anyone who has done any reading on ethics or morality can tell you very quickly that any moral decision of weight cannot be resolved with a formula. The Delphi system can’t make moral decisions. It’s like ELIZA: it could sound like a doctor but it couldn’t really help you with your mental health problem.

Too often people from IT blunder into a field, reduce the problems in them to something computational, produce a new system, and yell “Eureka!”.  The lack of humility is embarrassing.

What IT people should do is spend time reading and thinking about ethics and morality.. If they did, they’d be better off. If you are one of those people, go to fivebooks.com and search for “ethics” or “moral”. From those books you will learn something. You cannot learn anything from the Delphi system.

P.S. For more on that Delphi system, see: Can a Machine Learn Morality? – The New York Times.

(Photo by Gabriella Clare Marino on Unsplash )

On intelligence: in cells, in A.I., in us


This article on cells – yes, cells! – navigating mazes is fascinating and worth a read: Seeing around corners: Cells solve mazes and respond at a distance using attractant breakdown

After reading I thought: I need to rethink “intelligence”. Navigating mazes is something that was considered an intelligent act. Indeed one of the early experiments in A.I. was in the 1950s, when Marvin Minsky developed a smart “rat” (see above) to make its way through a maze. (That’s worth reading about as well.)

Seeing the cell navigate the maze, I thought: if the qualities we associate with intelligence are found at a cellular level, then I don’t really understand intelligence at all. It’s as if intelligence has an atomic level. As if intelligence is at all levels of life, not just the more complex levels.

Maybe the concept of intelligence is next to meaningless and needs to be replaced by something better. Read those pieces and think for yourself. After all, you are intelligent. 🙂

On Pepper and Watson


If you have even a passing knowledge of IT, you likely have heard of Pepper and Watson. Pepper was a robot and Watson was an AI system that won at Jeopardy. Last week the Verge and the New York Times had articles on them both:

  1. Go read how Pepper was a very bad robot – The Verge
  2. What Ever Happened to IBM’s Watson? – The New York Times

I don’t have any specific insights or conclusions into either technology, other than trite summations like “cutting edge technology is hard” and “don’t believe the hype”. AI and robotics are especially hard, so the risks are high and the chances of failure are high. That comes across in these two pieces.

Companies from Tesla to Boston Dynamics and more are making grand claims about their AI and their robotics. I suspect much of it will suffer the same fate as Pepper and Watson. Like all failure, none of it is final or fatal. People learn from their mistakes and move on to make better things. AI and robotics will continue to advance…just not at the pace many would like it too.

In the meantime, go read those articles.  Especially if you are finding yourself falling for the hype.

(Image: link of image on The Verge)

How to get more from your smart speakers


I am a fan of smart speakers, despite the privacy concerns around them. If you are ok with that and you have one or are planning to get one, read these two links to see how you can get more out of them:

  1. How to control Sonos with Google Assistant
  2. Alexa Skills That Are Actually Fun and Useful | WIRED

I use Google Assistant on my Sonos and they make a great device even better. And while I do have Google Home devices in other parts of the house, I tend to be around the Sonos most, so having it there to do more than just play music is a nice thing indeed.

Quote

Me: pandemic masks will make it hard to do face tracking. TensorFlow: we have face AND hand tracking


Yep. See here for more details:

Face and hand tracking in the browser with MediaPipe and TensorFlow.js — The TensorFlow Blog

 

Quote

Two ways to get more out of your Sonos One

  1. How to control Sonos with Google Assistant – good if you like / use Google assistant
  2. Sonos speakers now work with IFTTT so you can automate your music – good if you are a fan of IFTTT, like I am

The Sonos One is a smart little speaker. Using Google Assistant and IFTTT.com make it even smarter.

Quote

If you are thinking of using chatbots in your work, read this


Chatbots are relatively straightforward to deploy these days. AI providers like IBM and others provide all the technology you need. But do you really need them? And if you already have a bunch of them deployed, are you doing it right? If these questions have you wondering, I recommend you read this: Does Your Company Really Need a Chatbot?

You still may want to proceed with chatbots: they make a lot of business sense for certain types of work. But you will have a better idea when not to use them, too.

Quote

What are some of the flaws with facial recognition software?

What are some of the flaws with facial recognition software? Too many for me just to list. Instead, read this article to get a sense of how bad this software can be.

San Francisco is in the vanguard of trying to rein in this technology. Let’s hope more jurisdictions do the same.

Quote

How machine learning (ML) is different from artificial intelligence (AI)

I am glad to see more articles highlighting the difference between ML and AI. For example, this one: How machine learning is different from artificial intelligence – IBM Developer.

There is still lots to be done in the field of machine learning, but I think technologists and scientists need to break out of that tight circle and explore AI in general.

(Image: from the article)

Quote

Isn’t machine learning (ML) and Artificial Intelligence (AI) the same thing?


Nope. And this piece, Machine Learning Vs. Artificial Intelligence: How Are They Different?, does a nice job of reviewing them at a non-technical level. At the end, you should see the differences.

(The image, via g2crowd.com, also shows this nicely).

Quote

It’s Monday morning: are robots going to replace you at your job?

Possibly, but as this article argues, there are at least three areas where robots and suck at:

Creative endeavours: These include creative writing, entrepreneurship, and scientific discovery. These can be highly paid and rewarding jobs. There is no better time to be an entrepreneur with an insight than today, because you can use technology to leverage your invention.

Social interactions: Robots do not have the kinds of emotional intelligence that humans have. Motivated people who are sensitive to the needs of others make great managers, leaders, salespeople, negotiators, caretakers, nurses, and teachers. Consider, for example, the idea of a robot giving a half-time pep talk to a high school football team. That would not be inspiring. Recent research makes clear that social skills are increasingly in demand.

Physical dexterity and mobility: If you have ever seen a robot try to pick up a pencil you see how clumsy and slow they are, compared to a human child. Humans have millennia of experience hiking mountains, swimming lakes, and dancing—practice that gives them extraordinary agility and physical dexterity.

Read the entire article; there’s much more in it than that. But if your job has some element of those three qualities, chances are robots won’t be replacing you soon.

What I find interesting in tech, November 2017


Here’s an assortment of 42 links covering everything from Kubernetes to GCP and other cloud platforms to IoT to Machine Learning and AI to all sorts of other things. Enjoy! (Image from the last link)

  1. Prometheus Kubernetes | Up and Running with CoreOS , Prometheus and Kubernetes: DeployingKubernetes monitoring with Prometheus in 15 minutes – some good links on using Prometheus here
  2. Deploying a containerized web application  |  Container Engine Documentation  |  Google Cloud Platform – a good intro to using GCP
  3. How to classify workloads for cloud migration and decide on a deployment model – Cloud computing news – great insights for any IT Architects
  4. IP Address Locator – Where is this IP Address? – a handy tool, especially if you are browsing firewall logs
  5. Find a Google Glass and kick it from the networkDetect and disconnect WiFi cameras in that AirBnB you’re staying in– Good examples of how to catch spying devices
  6. The sad graph of software death – a great study on technical deby
  7. OpenTechSchool – Websites with Python Flask – get started building simple web sites using Python
  8. Build Your Own “Smart Mirror” with a Two-Way Mirror and an Android Device – this was something I wanted to do at some point
  9. Agile for Everybody: Why, How, Prototype, Iterate – On Human-Centric Systems – Medium – Helpful for those new or confused by Agile
  10. iOS App Development with Swift | Coursera – For Swift newbies
  11. Why A Cloud Guru Runs Serverless on AWS | ProgrammableWeb – If you are interested in serverless, this is helpful
  12. Moving tech forward with Gomix, Express, and Google Spreadsheets | MattStauffer.com – using spreadsheets as a database. Good for some
  13. A Docker Tutorial for Beginners – More Docker 101.
  14. What is DevOps? Think, Code, Deploy, Run, Manage, Learn – IBM Cloud Blog – DevOps 101
  15. Learning Machine Learning | Tutorials and resources for machine learning and data analysis enthusiasts – Lots of good ML links
  16. Importing Data into Maps  |  Google Maps JavaScript API  |  Google Developers – A fine introduction into doing this
  17. Machine learning online course: I just coded my first AI algorithm, and oh boy, it felt good — Quartz – More ML
  18. New Wireless Tech Will Free Us From the Tyranny of Carriers | WIRED – This is typical Wired hype, but interesting
  19. How a DIY Network Plans to Subvert Time Warner Cable’s NYC Internet Monopoly – Motherboard – related to the link above
  20. Building MirrorMirror – more on IT mirrors
  21. Minecraft and Bluemix, Part 1: Running Minecraft servers within Docker – fun!
  22. The 5 Most Infamous Software Bugs in History – OpenMind – also fun!
  23. The code that took America to the moon was just published to GitHub, and it’s like a 1960s time capsule — Quartz – more fun stuff. Don’t submit pull requests 🙂
  24. The 10 Algorithms Machine Learning Engineers Need to Know – More helpful ML articles
  25. User Authentication with the MEAN Stack — SitePoint – if you need authentication, read this…
  26. Easy Node Authentication: Setup and Local ― Scotch – .. or this
  27. 3 Small Tweaks to make Apache fly | Jeff Geerling – Apache users, take note
  28. A Small Collection of NodeMCU Lua Scripts – Limpkin’s blog – Good for ESP users
  29. Facebook OCP project caused Apple networking team to quit – Business Insider – Interesting, though I doubt Cisco is worried
  30. Hacked Cameras, DVRs Powered Today’s Massive Internet Outage — Krebs on Security – more on how IoT is bad
  31. Learn to Code and Help Nonprofits | freeCodeCamp – I want to do this
  32. A Simple and Cheap Dark-Detecting LED Circuit | Evil Mad Scientist Laboratories – a fun hack
  33. Hackers compromised free CCleaner software, Avast’s Piriform says | Article [AMP] | Reuters – this is sad, since CCleaner is a great tool
  34. Is AI Riding a One-Trick Pony? – MIT Technology Review – I believe it is and if AI proponents are not smart they will run into another AI winter.
  35. I built a serverless Telegram bot over the weekend. Here’s what I learned. – Bot developers might like this.
  36. Google’s compelling smartphone pitch – Pixel 2 first impressions | IT World Canada News – The Pixel 2 looks good. If you are interested, check this out
  37. Neural networks and deep learning – more ML
  38. These 60 dumb passwords can hijack over 500,000 IoT devices into the Mirai botnet – more bad IoT
  39. If AWS is serious about Kubernetes, here’s what it must do | InfoWorld – good read
  40. 5 Ways to Troll Your Neural Network | Math with Bad Drawings – interesting
  41. IBM, Docker grow partnership to drive container adoption across public cloud – TechRepublic – makes sense
  42.  Modern JavaScript Explained For Dinosaurs – fun

The home speaker / AI market heats up as Sonos makes advances

Sonos One

WIRED has a good review of the latest product from Sonos, here: Sonos One Review: Amazon’s Alexa Is Here, But It Still Has Some Growing Up to Do

What makes this development significant to me is that it signals that Sonos is concerned with Apple and others coming and taking away market share. Sonos has a great line of products already, but Apple is threatening to take a piece of that with their new home speaker with Siri/AI capability. Sonos has beefed up their AI capability to meet the challenge.

I expect that the next big thing in IT will be the vocal interface tied in with a speaker system in some form. I expect we will see them everywhere. Perhaps not for extended communication, but for brief and frequent requests.

If you are an IT person, I recommend you learn more about chatbot technology and how it will integrate with the work you are doing. More and more users will want to be able to communicate with your systems using voice. You need to provide a vocal interface for them to get information and send information.

Most homes will have one device acting as an aural hub. Sonos wants to make sure it is one they make, and not Apple.

How technology can enhance work and not simply eliminate it

robot and human working together

This piece: What it’s like to be a modern engraver, the most automated job in the United States — Quartz, reminded me once again that the best use of technology is to augment the people doing the work, and not simply take away the work. Must reading for anyone who’s believes that the best way to use AI and other advanced tech is to eliminate jobs. My believe is that the best way to use AI and other advanced tech is to make jobs better, both for the employee, the employer, and the customer. The businesses that will succeed will have that belief as well.

(Image from this piece on how humans and robots can work together.)

Some thoughts on the end of the CBC mail robots

mail robot
According to Haydn Waters, a writer at CBC, the mail robots at the corporation are being discontinued. Instead:

Mail will be delivered twice a week (Tuesday and Thursday) to central mail delivery/pickup locations on each floor.”

What gets lost in alot of discussions of robots, AI, etc., taking all the jobs is that the drivers for the decisions is not technology but economics. If there is no economical need for robots and other technology, then that technology will not just appear. There is nothing inevitable about technology, and any specific technology is temporary.

Of course there will be more use of robots and AI and other technology to replace the work people may currently do. The key to finding work will be to continually improvise and improve on the tasks one has to do to remain employed. That’s something humans do well, and technology will struggle with for some time in the future, AI hype not withstanding.

34 good links on AI, ML, and robots (some taking jobs, some not)

If you are looking to build AI tech, or just learn about it, then you will find these interesting:

  1. Artificial intelligence pioneer says we need to start over – Axios – if Hinton says it, it is worth taking note
  2. Robots Will Take Fast-Food Jobs, But Not Because of Minimum Wage Hikes | Inverse – true. Economists need to stop making such a strong link here.
  3. Artificial Intelligence 101: How to Get Started | HackerEarth Blog – a good 101 piece
  4. Deep Learning Machine Teaches Itself Chess in 72 Hours, Plays at International Master Level – MIT Technology Review – the ability of tech to learn is accelerating.
  5. Now AI Machines Are Learning to Understand Stories – MIT Technology Review – and not just accelerating, but getting deeper.
  6. Robots are coming for your job. That might not be bad news – good alternative insight from Laurie Penny.
  7. Pocket: Physicists Unleash AI to Devise Unthinkable Experiments – not surprisingly, a smart use of AI
  8. AI’s dueling definitions – O’Reilly Media – this highlights one of the problems with AI, and that it is it is a suitcase word (or term) and people fill it with what they want to fill it with
  9. A Neural Network Playground – a very nice tool to start working with AI
  10. Foxconn replaces ‘60,000 factory workers with robots’ – BBC News – there is no doubt in places like Foxconn, robots are taking jobs.
  11. 7 Steps to Mastering Machine Learning With Python – don’t be put off by this site’s design: there is good stuff here
  12. How Amazon Triggered a Robot Arms Race – Bloomberg – Amazon made a smart move with that acquisition and it is paying off
  13. When Police Use Robots to Kill People – Bloomberg this is a real moral quandary and I am certain the police aren’t the only people to be deciding on it. See also: A conversation on the ethics of Dallas police’s bomb robot – The Verge
  14. How to build and run your first deep learning network – O’Reilly Media – more good stuff on ML/DL/AI
  15. This expert thinks robots aren’t going to destroy many jobs. And that’s a problem. | The new new economy – another alternative take on robots and jobs
  16. Neural Evolution – Building a natural selection process with AI – more tutorials
  17. Uber Parking Lot Patrolled By Security Robot | Popular Science – not too long after this, one of these robots drowned in a pool in a mall. Technology: it’s not easy 🙂
  18. A Robot That Harms: When Machines Make Life Or Death Decisions : All Tech Considered : NPR – this is kinda dumb, but worth a quick read.
  19. Mathematics of Machine Learning | Mathematics | MIT OpenCourseWare – if you have the math skills, this looks promising
  20. Small Prolog | Managing organized complexity – I will always remain an AI/Prolog fan, so I am including this link.
  21. TensorKart: self-driving MarioKart with TensorFlow – a very cool application
  22. AI Software Learns to Make AI Software – MIT Technology Review – there is less here than it appears, but still worth reviewing
  23. How to Beat the Robots – The New York Times – meh. I think people need to learn to work with the technology, not try to defeat it. If you disagree, read this.
  24. People want to know: Why are there no good bots? – bot makers, take note.
  25. Noahpinion: Robuts takin’ jerbs
  26. globalinequality: Robotics or fascination with anthropomorphism – everyone is writing about robots and jobs, it seems.
  27. Valohai – more ML tools
  28. Seth’s Blog: 23 things artificially intelligent computers can do better/faster/cheaper than you can – like I said, everyone is writing about AI. Even Seth Godin.
  29. The Six Main Stories, As Identified by a Computer – The Atlantic – again, not a big deal, but interesting.
  30. A poet does TensorFlow – O’Reilly Media – artists will always experiment with new mediums
  31. How to train your own Object Detector with TensorFlow’s Object Detector API – more good tooling.
  32. Rise of the machines – the best – by far! – non-technical piece I have read about AI and robots.
  33. We Trained A Computer To Search For Hidden Spy Planes. This Is What It Found. – I was super impressed what Buzzfeed did here.
  34. The Best Machine Learning Resources – Machine Learning for Humans – Medium – tons of good resources here.

Very cool. Build a Google Home for Only $35

This is a pretty cool DIY project: The AIY Voice Kit Lets You Build a Google Home for Only $35.

Now, I have my qualms about letting Google have access to so much personal information. If you do not have such qualms and you want to build a cool project, click the link and head on over to Wired, where they have more information on it and how to get it.

AI is hard, China version

According to this, chatbots in China have been removed after being critical of the Chinese government. This to me is not unlike what happened to Microsoft's chat bot that became racist after being feed racist input from users. If you put AI out there and allow any form of input, then the equivalent of vandals can overtake you AI and feed it whatever they choose. I'm not certain if that was the case in China but I suspect it was.

AI researchers need to expect the worst case use cases if they allow their software to do unsupervised learning on the Internet. If they don't, it's likely that their projects will be a disaster and they will do damage to the AI community in general.

Jean-Luc Mélenchon, a candidate right out of a Philip K Dick Novel

Melenchon hologram
In France, politician Jean-Luc Mélenchon plans to be in seven places at once using  something similar to a hologram. According to Le Parisien:

Strictly speaking, these are not holograms. Jean-Luc Mélenchon will be present in seven different places thanks to … an optical illusion discovered for the first time half a century ago by an Italian physicist

Virtual Mélenchon reminds me of the politician Yance in Philip K Dick’s novel, The Penultimate Truth. We may not be far off where we get virtual candidate that look like people but behind the scenes we have AI or some combination of AI and people.

For more on the technology, see the article in Le Parisien. For more on Dick’s novel, see Wikipedia. Read up now: I think we can expect to see more of this technology in use soon.

It’s not because most developers are white that AI has hard time with non-white faces. It’s this….

An example of a neural net topology
This piece, Most engineers are white — and so are the faces they use to train software – Recode, implies that AI software doesn’t do a good job recognizing non-white faces because most engineers (i.e. software developers) are white. I’d argue that the AI does a poor job because of this: the developers aren’t very good.

Good software developers, in particular the lead developers, take an active role in ensuring they have good test data. The success of their software when it goes live is dependent on it. Anyone using training data  (i.e. using test data) in AI projects that is not using a broad set of faces is doing a poor job. Period. Regardless of whether or not they are white.

If the AI is supposed to do something (i.e. recognize all faces) and it does not, then the AI sucks. Don’t blame it on anything but technical abilities.

 

 

Facebook shows why we need augmented intelligence (Artificial and Human Intelligence)

Because if you don’t have augmented intelligence, and if you solely depend on AI like software, you get problems like this, whereby automated software triggers an event that a trained human might have picked up on.

AI and ML (machine learning) can be highly probabilistic and limited to the information it is trained on. Having a human involved makes up for those limits. Just like AI can process much more information quicker than a limited human can.

See the link to the New York Times story to see what I mean.

How IBM Watson helped Time magazine narrow its search for Person of the Year 

Interesting article: How IBM Watson helped Time magazine narrow its search for Person of the Year (IT Business)

From a technology point of view, it is also interesting that the IBM partner was using IBM’s Watson and Bluemix technologies.

I am biased here, as someone who works for IBM and believes in these technology, but I do think that if you think A.I. and cognitive doesn’t have a place in your business, you should read this. In the next two years, expect all your competitors to adopt these new technologies to compete with you.

A great primer on self driving trucks that everyone should read. (Really!)

This piece, 1.8 million American truck drivers could lose their jobs to robots. What then? (Vox) is a great primer on self driving trucks and how they are going to have a major impact sooner than later.

If you are interested in IT, AI or robots, it really shows one of the places where this technology is going to have a significant impact.

If you are interested in economics, politics, or sociology, then the effect of robots replacing all these truck drivers is definitely something you want to be aware of.

If you drive on highways, you definitely want to know about it.

In any case, it’s a good piece by David Roberts. That is his beat and I find he always does a great job of breaking down a topic like this and making it easier to understand and relevant to me. I recommend any of his pieces.

Want to understand what artificial intelligence and machine learning is?

If you want a better understanding of artificial intelligence or if you want to gain some insight into the future of machine learning, I recommend these two free reports, found here: Free AI Reports from  O’Reilly Media. There’s so much hype and speculation about AI: these reports cut through all that noise and they will give you a better understanding of what A.I. really is and where it is going.

P.S. If you like them, check out the many great non-A.I. related reports as well. You don’t have to be a technologist to be able to read them.

More thoughts on Waze

I have thought a lot about Waze since I started using it. Without a doubt, it has improved my life substantially. Here are some other thoughts I had as I used it.

  1. Waze is an example of how software will eat the world. In this case, the world of gPS devices. Waze is a GPS on steroids. Not only will Waze do all the things that a GPS will do, but it does so much more, as you can see from this other Waze post I wrote. If you have a GPS, after you use Waze for a bit, you’ll likely stop using it.
  2. Waze will change the way cities work. Cities are inefficient when it comes to transportation. Our work habits contribute to that, in that so many people commute at the same time, in the same direction, on the same routes, each work day. Waze and other new forms of adding intelligence to commuting will shape our work habits over time. Drivers being able to take advantage of unbusy streets to reduce congestion on major thoroughfares is just the start. City planners could work with Waze to better understand travel patterns and travel behaviour and incorporate changes into the city  so that traffic flows better. It’s not that city planners don’t have such data, it’s that Waze likely has more data and better data than they currently have.
  3. Waze is a great example of how A.I. could work. I have no idea how much A.I. is built into Waze. It could be none, it could be alot. It does make intelligent recommendations to me, and that is all I care about. How it makes those intelligent recommendations is a black box. Developers of A.I. technologies should look at Waze as an example of how best to deploy A.I. Those A.I. developers should look at how best A.I. can solve a problem for the user and spend less time trying to make the A.I. seem human or overly intelligent. People don’t care about that. They care about practical applications of A.I. that make their lives better. Waze does that.

What drives A.I. development? Better data

This article, Datasets Over Algorithms — Space Machine, makes a good point, namely

…perhaps many major AI breakthroughs have actually been constrained by the availability of high-quality training datasets, and not by algorithmic advances.

Looking at this chart they provide illustrates the point:

I’d argue that it isn’t solely datasets that drive A.I. breakthroughs. Better CPUs, improved storage technology, and of course new ideas can also propel A.I. forward. But if you ask me now, I think A.I. in the future will need better data to make big advances.