Category Archives: Open Source

Open Source-related

Hadoop Has No Business Model

I had a chance to talk to a Big Data sales manager 5 years ago. He said, “Hadoop is a tough sale on the East Coast. Hoping Spark will help.” Now, MapR is facing insolvency and Cloudera/Hortonworks isn’t doing great. … Continue reading

Posted in Hadoop, Java, Open Source, Tech | Leave a comment

Announcement: check_s3_encryption.sh Linux Utility Available

Announcing a new SRE utility I wrote called check_s3_encryption.sh to report and optionally encrypt any AWS S3 unencrypted buckets: it can be run from the command line or a crontab it’s useful for IT compliance MIT License. See the README … Continue reading

Posted in Cloud, Linux, Open Source, Tech | Leave a comment

oom-report linux Utility

Announcing a new SRE utility I wrote for processing linux syslog Out of Memory (OOM) entries, oom-report. It parses logfiles for OOMs and reports on how much RAM (vm + rss) each process used and sorts from smallest to largest. … Continue reading

Posted in Java, Linux, Open Source, Tech | Leave a comment

Cassandra vnodes Streaming Reliability Calculator

The Cassandra database has a setting in cassandra.yaml, num_tokens, for the number of vnodes. num_tokens is the number of partitions to use per host, and thus the number of parallel streams to use for data updates. The default was 256 … Continue reading

Posted in Cassandra, Open Source, Tech | Leave a comment

Gitlab for Users Transitioning from Github

After using Github for several years, I recently used Gitlab for a solo developer project. Some of the differences I noticed over the past two weeks were: 1. After initial signup, I got a 422 error HTTP response for about … Continue reading

Posted in Cloud, Open Source, Tech | Leave a comment