Tag Archives: cloud

What I find interesting in tech, April 2021. Now with Quantum Computing inside!

Here’s 9000 links* on things I have found interesting in tech in the last while. There’s stuff on IT Architecture, cloud, storage, AIX/Unix, Open Shift, Pico, code, nocode, lowcode, glitch. Also fun stuff, contrarian stuff, nostalgic stuff. So much stuff. Good stuff! Stuff I have been saving away here and there.

On IT Architecture: I love a good reference architecture. Here’s one from an IBM colleague. If you need some cloud adoption patterns when doing IT architecture, read this. Here’s a tool to help architects design IBM Cloud architectures. Like it. Here’s some more tools to do IBM Cloud Architecture. Architectural Decision documentation is a key to being a good IT architect. Here’s some guidance on how to capture ADs. This is also good on
ADs I liked this:some good thoughts on software architecture.

Here’s some thoughts from a leading IT architect in IBM, Shahir Daya. He has a number of good published pieces including this and this.

One of my favorite artifacts as an architect is a good system context diagram. Read about it here. Finally, here’s a piece on UML that I liked.

Cloud: If you want to get started in cloud, read this on starting small. If you are worried about how much cloud can cost, then this is good. Here’s how to connect you site to others using VPN (good for GCP and AWS). A great piece on how the BBC has gone all in on serverless.. For fans of blue green deployments, read this. A good primer on liveness and readiness probes. Want to build you own serverless site? Go here

Storage: I’ve had to do some work recently regarding cloud storage. Here’s a
good tool to help you with storage pricing (for all cloud platforms). Here’s a link to help you with what IBM Cloud storage will cost. If you want to learn more about IBM Object storage go there. If you want to learn about the different type of storage, click here and here.

AIX/Unix: Not for everyone, but here is a good Linux command handbook. And here is a guide to move an AIX LPAR from one server to another. I recommend everyone who use any form of Unix, including MacOS, read
this. That’s a good guide to awk, sed and jq.

Open Shift:  If you want to learn more about Open Shift, this is a good intro. This is a good tutorial on deploying a simple app to Open Shift. If you want to try Open Shift, go here.

Raspberry Pi Pico:  If you have the new Pico, you can learn to set it up here.
Here’s some more intros to it. Also here. Good stuff. Also good is this if you want to add ethernet to a Raspberry Pi pico.

On Networking: If you want to know more about networking you want to read this, this and this. Also this. Trust me.

Code: Some good coding articles. How to process RSS using python. How to be a more efficient python programmer. Or why you should use LISP. To do NLP with Prolog the way IBM Watson did, check this out. If you want to make a web app using python and Flask, go here. If you need some python code to walk through all files within the folder and subfolders and get list of all files that are duplicates then you want this. Here’s how to set up your new MacBook for coding. Here’s a good piece on when SQL Isn’t the Right Answer

Glitch: I know people who are big fans of Glitch.com. If you want to see it’s coolness in action, check. out this and this

No Code Low Code: If you want to read some good no-code/low-code stuff to talk to other APIs, then check out this, this, and this.

Bookmarking tool: If you want to make your own bookmarking tool, read
this, this and this. I got into this because despite my best efforts to use the API of Pocket, I couldn’t get it to work. Read this and see if you get further.

Other things to learn: If you want to learn some C, check out this. AI? Read this Open Shift? Scan this. What about JQuery? Read this or that Bootstrap. this or this piece. Serverless? this looks fun. PouchDB? this and this. Express for Node? this. To use ansible to set up WordPress on Lamp with Ubuntu, go over this. To mount an NFTS mount on a Mac, see this. Here’s how to do a Headless Raspberry Pi Setup with Raspbian Stretch

Also Fun: a Dog API. Yep. Here is CSS to make your website look like Windows 98. A very cool RegEx Cheatsheet mug.. And sure, you can run your VMs in Minecraft if you go and read this. If you want to read something funny about the types of people on an IT project, you definitely want this.

Contrarian stuff: Here are some contrarian tech essays I wanted to argue against, but life is too short. Code is law. Nope. Tech debt doesn’t exist.Bzzzt. Wrong. Don’t teach your kids to code. Whatever dude. Use ML to turn 5K into 200K. Ok. Sure.

Meanwhile: Back to earth, if you want to use bluetooth tech with your IOT projects, check out this, this, this, and this. If you have an old Intel on a stick computer and want to upgrade it (I do), you want this. If you want to run a start up script on a raspberry pi using crontab, read this If you want to use Google Gauge Charts on your web site, then read this and this.

Nostalgia: OS/2 Warp back in the 90s was cool. Read all about it
here.Think ML is new? Read about Machine Learning in 1951
here. This is a good piece on Xerox Parc. Here is some weird history on FAT32. And wow, here is the source code for CP/67/CMS. And I enjoyed this on Margaret Hamilton.

Finally: Here are IBM’s design principles to combat domestic abuse. Here is how and why to start building useful real world-software with no experience. Lastly, the interesting history of the wrt54g router

(* Sorry there was less than 9000 links. Also no quantum computing inside this time. Soon!)

Need a temporary Mac? Now with AWS, you can get one!

How? By using their cloud service: AWS brings the Mac mini to its cloud.

Perfect for those times you need access to a Mac for a short period of time (e.g. testing software).

Throughout my career I have been involved with Macs and cloud technology. I remember when Apple made Mac servers. There was even a separate MacOS for them. So I am loving this evolution and the repositioning of Macs in a data center.

Image from here which also has a write up on this.

 

What I find interesting in tech, November 2020

Kubernetes

Here’s 59 links (!) of things I have found interesting in tech in the last while. It ‘s heavily skewed towards Kubernetes because that’s mostly what I have been involved with. Some stuff on Helm, since I was working on a tricky situation with Helm charts. There’s some docker and Open Shift of course, since it’s related. There’s a few general pieces on cloud. And finally at the end there’s links to a bunch of worthwhile repos.

Almost all of these links are self explanatory. The ones that aren’t…well…few if anyone but me reads these posts anyway. 🙂 Just treat it like a collection of potentially good resources.

  1. How to create custom Helm charts
  2. How to make a Helm chart in 10 minutes | Opensource.com
  3. Basic kubectl and Helm commands for beginners | Opensource.com
  4. A visual guide on troubleshooting Kubernetes deployments
  5. Kubernetes Canary Deployments for User Beta testing | by Damien Marshall | ITNEXT
  6. Hands-on guide: developing & deploying Node.js apps in Kubernetes
  7. Deploying Java Applications with Docker and Kubernetes – O’Reilly
  8. Kubernetes, Kafka Event Sourcing Architecture Patterns, and Use Case Examples – DZone Big Data
  9. 10 most important differences between OpenShift and Kubernetes – cloudowski.com
  10. Node.js in a Kubernets world – IBM Developer
  11. Learn Kubernetes in Under 3 Hours: A Detailed Guide to Orchestrating Containers
  12. Service accounts — Kubernetes on AWS 0.1 documentation
  13. Copy directories and files to and from Kubernetes Container [POD] | by Nilesh Suryavanshi | Medium
  14. Monitoring Kubernetes in Production: How To Guide | Sysdig
  15. Kubernetes Cheat Sheet | Red Hat Developer
  16. Kubernetes In a Nutshell | Enqueue Zero
  17. Kubernetes Deployment in a Nutshell | Clivern
  18. Kubernetes namespaces for beginners | Opensource.com
  19. Level up your use of Helm on Kubernetes with Charts | Opensource.com
  20. Running Solr on Kubernetes
  21. Solr on Kubernetes on Portworx
  22. Zookeeper – Unofficial Kubernetes
  23. Kubernetes for Everyone
  24. Chris Biscardi’s Digital Garden
  25. Istio / Getting Started
  26. How To Set Up a Kubernetes Monitoring Stack with Prometheus, Grafana and Alertmanager on DigitalOcean | DigitalOcean
  27. Kubernetes Ingress Controllers: How to choose the right one: Part 1 | by Eric Liu | ITNEXT
  28. An introduction to Minishift, OpenShift, and IBM Cloud – IBM Developer
  29. How To Set Up an Nginx Ingress on DigitalOcean Kubernetes Using Helm | DigitalOcean
  30. An introduction to Kubernetes.
  31. Health checks in Kubernetes for your Node.js applications – IBM Developer
  32. Beyond the basics with Cloud Foundry – IBM Developer
  33. Build a cloud-native Java app using Codewind and your favorite IDE – IBM Developer
  34. Accelerating the application containerization journey – Cloud computing news
  35. 6 Key Elements for a Successful Cloud Migration | IBM
  36. An introduction to Minishift, OpenShift, and IBM Cloud – IBM Developer
  37. There aren’t enough humans for cloud-native infra. Can DevOps deal? – SiliconANGLE
  38. Leverage deep learning in IBM Cloud Functions – IBM Developer
  39. CloudReady for Home: Free Download — Neverware
  40. Council Post: It’s Time To Accelerate Your Hybrid Or Multicloud Strategy
  41. Getting started with solution tutorials
  42. How to get started with GCP  |  Google Cloud
  43. Setting up Solr Cloud 8.4.1 with Zookeeper 3.5.6 | by Amrit Sarkar | Medium
  44. solr – How to force a leader on SolrCloud? – Stack Overflow
  45. Play with Docker Classroom
  46. Getting any Docker image running in your own OpenShift cluster
  47. Building Docker Images inside Kubernetes | by Vadym Martsynovskyy | Hootsuite Engineering | Medium
  48. Get an IBM MQ queue for development on Windows – IBM Developer
  49. Ultimate Guide to Installing Kafka Docker on Kubernetes – DZone Big Data
  50. Kafka on Kubernetes — a good fit? | by Johann Gyger | Noteworthy – The Journal Blog
  51. How To Install Apache Kafka on Debian 10 | DigitalOcean
  52. Chapter 7. Monitoring and performance – Kafka Streams in Action: Real-time apps and microservices with the Kafka Streams API [Book]
  53. charts/incubator/cassandra at master · helm/charts · GitHub
  54. atlas-helm-chart/charts/zookeeper at master · xmavrck/atlas-helm-chart · GitHub
  55. nhs-app-helm-chart/solr.yaml at master · pajmd/nhs-app-helm-chart · GitHub
  56. GitHub – manjitsin/atlas-helm-chart: Kubernetes Helm Chart to deploy Apache Atlas
  57. GitHub – IBM/Scalable-WordPress-deployment-on-Kubernetes: This code showcases the full power of Kubernetes clusters and shows how can we deploy the world’s most popular website framework on top of world’s most popular container orchestration platform.
  58. A Dockerfile with (almost) all the tools mentioned in Bite Size Networking by Julia Evans · GitHub
  59. GitHub – sburn/docker-apache-atlas: This Apache Atlas is built from the latest release source tarball and patched to be run in a Docker container.
Quote

Is Cloud Computing Green?

It depends on how you measure it, but according to this New York Times Article, cloud computing has brought environmental benefits.

The article starts with this:

The computer engine rooms that power the digital economy have become surprisingly energy efficient.

A new study of data centers globally found that while their computing output jumped sixfold from 2010 to 2018, their energy consumption rose only 6 percent. The scientists’ findings suggest concerns that the rise of mammoth data centers would generate a surge in electricity demand and pollution have been greatly overstated.

That’s good. The other good thought here is that centralized computing can continue to drive out efficiencies that distributed computing can not.

All in all, one more reason for companies to embrace cloud computing.

How to better understand Kubernetes networking

Kubernetes networking is a non-trivial thing to understand, but if you are going to get into the use of Kubernetes, then you need to understand it. This trio of posts is a good way to do that. Highly recommended.

  1. Understanding kubernetes networking: pods – Google Cloud Platform — Community – Medium
  2. Understanding kubernetes networking: services – Google Cloud Platform — Community – Medium
  3. Understanding kubernetes networking: ingress – Google Cloud Platform — Community – Medium

What I find interesting in tech, November 2017


Here’s an assortment of 42 links covering everything from Kubernetes to GCP and other cloud platforms to IoT to Machine Learning and AI to all sorts of other things. Enjoy! (Image from the last link)

  1. Prometheus Kubernetes | Up and Running with CoreOS , Prometheus and Kubernetes: DeployingKubernetes monitoring with Prometheus in 15 minutes – some good links on using Prometheus here
  2. Deploying a containerized web application  |  Container Engine Documentation  |  Google Cloud Platform – a good intro to using GCP
  3. How to classify workloads for cloud migration and decide on a deployment model – Cloud computing news – great insights for any IT Architects
  4. IP Address Locator – Where is this IP Address? – a handy tool, especially if you are browsing firewall logs
  5. Find a Google Glass and kick it from the networkDetect and disconnect WiFi cameras in that AirBnB you’re staying in– Good examples of how to catch spying devices
  6. The sad graph of software death – a great study on technical deby
  7. OpenTechSchool – Websites with Python Flask – get started building simple web sites using Python
  8. Build Your Own “Smart Mirror” with a Two-Way Mirror and an Android Device – this was something I wanted to do at some point
  9. Agile for Everybody: Why, How, Prototype, Iterate – On Human-Centric Systems – Medium – Helpful for those new or confused by Agile
  10. iOS App Development with Swift | Coursera – For Swift newbies
  11. Why A Cloud Guru Runs Serverless on AWS | ProgrammableWeb – If you are interested in serverless, this is helpful
  12. Moving tech forward with Gomix, Express, and Google Spreadsheets | MattStauffer.com – using spreadsheets as a database. Good for some
  13. A Docker Tutorial for Beginners – More Docker 101.
  14. What is DevOps? Think, Code, Deploy, Run, Manage, Learn – IBM Cloud Blog – DevOps 101
  15. Learning Machine Learning | Tutorials and resources for machine learning and data analysis enthusiasts – Lots of good ML links
  16. Importing Data into Maps  |  Google Maps JavaScript API  |  Google Developers – A fine introduction into doing this
  17. Machine learning online course: I just coded my first AI algorithm, and oh boy, it felt good — Quartz – More ML
  18. New Wireless Tech Will Free Us From the Tyranny of Carriers | WIRED – This is typical Wired hype, but interesting
  19. How a DIY Network Plans to Subvert Time Warner Cable’s NYC Internet Monopoly – Motherboard – related to the link above
  20. Building MirrorMirror – more on IT mirrors
  21. Minecraft and Bluemix, Part 1: Running Minecraft servers within Docker – fun!
  22. The 5 Most Infamous Software Bugs in History – OpenMind – also fun!
  23. The code that took America to the moon was just published to GitHub, and it’s like a 1960s time capsule — Quartz – more fun stuff. Don’t submit pull requests 🙂
  24. The 10 Algorithms Machine Learning Engineers Need to Know – More helpful ML articles
  25. User Authentication with the MEAN Stack — SitePoint – if you need authentication, read this…
  26. Easy Node Authentication: Setup and Local ― Scotch – .. or this
  27. 3 Small Tweaks to make Apache fly | Jeff Geerling – Apache users, take note
  28. A Small Collection of NodeMCU Lua Scripts – Limpkin’s blog – Good for ESP users
  29. Facebook OCP project caused Apple networking team to quit – Business Insider – Interesting, though I doubt Cisco is worried
  30. Hacked Cameras, DVRs Powered Today’s Massive Internet Outage — Krebs on Security – more on how IoT is bad
  31. Learn to Code and Help Nonprofits | freeCodeCamp – I want to do this
  32. A Simple and Cheap Dark-Detecting LED Circuit | Evil Mad Scientist Laboratories – a fun hack
  33. Hackers compromised free CCleaner software, Avast’s Piriform says | Article [AMP] | Reuters – this is sad, since CCleaner is a great tool
  34. Is AI Riding a One-Trick Pony? – MIT Technology Review – I believe it is and if AI proponents are not smart they will run into another AI winter.
  35. I built a serverless Telegram bot over the weekend. Here’s what I learned. – Bot developers might like this.
  36. Google’s compelling smartphone pitch – Pixel 2 first impressions | IT World Canada News – The Pixel 2 looks good. If you are interested, check this out
  37. Neural networks and deep learning – more ML
  38. These 60 dumb passwords can hijack over 500,000 IoT devices into the Mirai botnet – more bad IoT
  39. If AWS is serious about Kubernetes, here’s what it must do | InfoWorld – good read
  40. 5 Ways to Troll Your Neural Network | Math with Bad Drawings – interesting
  41. IBM, Docker grow partnership to drive container adoption across public cloud – TechRepublic – makes sense
  42.  Modern JavaScript Explained For Dinosaurs – fun

Serious about your music? You might want to avoid Apple Music then

If you are serious about your music and you already have alot of digital music, you must read this before getting started with Apple Music: Apple Music is a nightmare and I’m done with it. If you don’t read it and proceed, you may find your music collection in shambles.

Maybe it will be better in a year from now. Based on iTunes, though, I seriously doubt it.

How to be more productive at work? check out what tools other people use

Chances are, if you talk to five different people at work, you will find five tools or techniques they use to be productive that you hadn’t even heard of.

Rather than do your own polling, you can also check out this article: Most Popular Apps Employees Use At Work – Business Insider.

Remember, these are just for work, and yes, Facebook still shows up there. And this is just the cloud / distributed services. (Also, I am wondering Evernote didn’t show up there.)

I  would be surprised if you read it and didn’t adopt at least one of the items on the list by the end of your work day. Good luck.

How IBM SoftLayer’s Private Network works (technical, obvs)

Many clients ask about this, and there is often confusion over the private aspect of the network. Confused or not, a good place to get clarification is here: Private Network | SoftLayer Blog.

Here’s a representation of the networking layout (you can get a bigger version of it at the SoftLayer blog):

A simple example of how to set up a PHP-MySQL application in IBM Bluemix (including the code you need)

While PHP is not one of the standard runtimes provided in the Bluemix catalog, the sample code in this git repo (
https://hub.jazz.net/git/u27275/blm-hello-world-php/) will show you how to bring your own buildpack, and this buildpack will allow you to have PHP code running in Bluemix that also can talk to a MySQL database running in Bluemix.

Among the files there is a PDF providing detailed instructions on how to set things up in IBM Bluemix.

P.S. This is sample code.  See the licence file in the repo for more details.

Are you looking to move things to the cloud?

Then I recommend you review this article: How to classify workloads for cloud migration and decide on a deployment model – Thoughts on Cloud.

I really like this diagram, for starters:

P.S. Yes, it is hard to read, I know. The article has a version that is readable.

Bezos’s (naturally) says it’s time to ditch the datacenter for cloud computing

And he and Softlayer (part of IBM) make a good case for it here: Bezos’s law signals it’s time to ditch the data center  in Tech News and Analysis.

This reminds me of a similar article, by Nicholas Carr, that was famous some time ago: Does IT Matter?

In both cases, where IT is a commodity like electricity or running water, getting the lowest cost and most generic (but good quality) version of it should be the goal.

However, IT can also be used as a differentiator. So can a data center. In those cases, company’s should control and manage their IT / data center to give themselves a competitive advantage.

P.S. As always, these views are my own and not necessarily my employers. See the “About” page for more on this.

A good list of Bluemix benefits here

I highly recommend this post on the top five benefits of Bluemix for anyone considering using PaaS, Bluemix, or cloud technologies in general.

The significance of cloud computing, as explained by the great Stephen Fry (@stephenfry)

This is a really well done video on the importance of cloud computing. It’s 5 minutes long, and well worth it.

Obviously, I would argue that your best bet for Cloud Computing services is from the company I work for, but otherwise I highly recommend this.

Who will be the big losers in the recent price drops in cloud computing?

Over at The Motley Fool, there is this article, The Big Losers in the Cloud Pricing Wars, that talks about recent price drops for services at Amazon and Google and how these price drops will affect the cloud computing business. (The Cloud Pricing Wars is very dramatic – I am not sure it is an all out battle at this point: we need more time to see if that becomes the case)

Anyone interested in cloud computing should check it out.

Is the Dropbox DMCA takedown thing new? And can Dropbox even do that?

I’ve been seeing this showing up on Twitter alot lately:

And so I had two questions: 1) is this new? 2) and can Dropbox do this? I found the answers here: About that Dropbox DMCA thing … | Android Central. The short answers are 1) no 2) yes. (Click through the link for the details.)

Dropbox is a great tool for sharing files, provided they are yours. Always remember: the Dropbox folder is not “yours”, even if the files you place there are. (And if they are not your files, then you have another set of problems.)

 If your files are important, I recommend you don’t make Dropbox your one and only place to store them. The more important files are to you, the more backups you should have.