Strategic Developer

Why Spark 1.6 is a big deal for big data

Already the hottest thing in big data, Spark 1.6 turns up the heat. Here are the high points, including improved streaming and memory management

By Ian Pointer

Jan 14, 2016 5 mins

Development Tools Hadoop Open Source

16 for ’16: What you must know about Hadoop and Spark right now

Amazingly, Hadoop has been redefined in the space of a year. Let's take a look at all the salient parts of this roiling ecosystem and what they mean

By Andrew C. Oliver

Jan 8, 2016 15 mins

Hadoop Jakarta EE Technology Industry

10 things to worry about in 2016

Yes, it's the poignant sequel to <a href="http://www.infoworld.com/article/3013229/application-development/10-things-you-dont-need-to-worry-about-in-2016.html">last week's reprieve</a>: a jolly list of worries to keep ....

By Andrew C. Oliver

Dec 18, 2015 13 mins

Hacking Hadoop JavaScript

10 things you don’t need to worry about in 2016

Are you ready for 2016? Of course you aren't -- you don't even want to think about it. If you need excuses for your lack of forethought, read on

By Andrew C. Oliver

Dec 10, 2015 10 mins

Databases Hadoop Technology Industry

Up close with Google’s Angular 2 JavaScript framework

Here's all you need to know about Angular 2, the exciting new successor to Google's wildly popular JavaScript framework, AngularJS

By Pamela Selle

Dec 3, 2015 5 mins

Java ME JavaScript Web Development

We don’t need a million new Spark jockeys

Spark may have taken big data by storm, but IBM's promise to train a million people on Spark goes too far, mainly because the technology is evolving too fast

By Andrew C. Oliver

Nov 19, 2015 4 mins

Analytics Data Management Software Development

5 things we hate about Spark

Spark has dethroned MapReduce and changed big data forever, but that rapid ascent has been accompanied by persistent frustrations

By Ian Pointer

Nov 12, 2015 7 mins

Development Tools Hadoop Jakarta EE

Joyent: The Docker-friendly cloud you’ve never heard of

Joyent started the container party, later validated by Docker. Despite superior technology, does an independent public cloud like Joyent have a chance?

By Andrew C. Oliver

Nov 5, 2015 7 mins

Cloud Computing Open Source PaaS

Why client-server must die

Old models of computing always tend to linger too long, but client-server was based on a fallacy -- and needs to go away sooner rather than later

By Andrew C. Oliver

Oct 29, 2015 4 mins

Databases Software Development Technology Industry

All the cool companies are doing big data

A survey from Dell says that growth companies are turning to big data in droves

By Andrew C. Oliver

Oct 22, 2015 3 mins

Business Intelligence Data Science Predictive Analytics

9 developer trends you can bank on in 2016

From containers to NoSQL to Spark, here are the IT trends you can expect to persist next year

By Andrew C. Oliver

Oct 15, 2015 5 mins

Hadoop NoSQL Databases Predictive Analytics

NoSQL simply isn’t hip anymore

The once red-hot database technology is losing its luster, as NoSQL reaches mass adoption

By Andrew C. Oliver

Oct 8, 2015 4 mins

Cloud Computing Databases NoSQL Databases

Why self-service is everything in BI and big data

Empower users to acquire and manipulate the data they really need, and BI can become a magnitude more useful -- and much less work for IT

By Andrew C. Oliver

Oct 1, 2015 3 mins

Business Intelligence Data Visualization Hadoop

6 takeaways from Cloudera’s embrace of Spark

It's official: The Hadoop ecosystem has received a brain transplant. Here's how Cloudera, the leading Hadoop vendor, laid out the implications of swapping MapReduce for Spark

By Andrew C. Oliver

Sep 25, 2015 5 mins

Data Management Hadoop

Hadoop is slowly eating conventional analytics

The components of the Hadoop ecosystem won't overthrow Teradata or IBM Netezza any time soon, but ultimately, the commodity solution almost always wins

By Andrew C. Oliver

Sep 24, 2015 5 mins

Business Intelligence Data Warehousing Hadoop

Hadoop, in trouble? Only in Gartner-land

A new poll of customers provides a brighter, more detailed picture of Hadoop adoption than Gartner's famously downbeat survey

By Andrew C. Oliver

Sep 17, 2015 7 mins

Business Intelligence Hadoop Technology Industry

The big greenfield cannabis cloud

The marijuana business is making the leap from paper ledgers to the cloud and big data analytics, offering a provocative example for us all

By Andrew C. Oliver

Sep 10, 2015 5 mins

Cloud Storage Hadoop Private Cloud

15 rules for quitting your job

We all have our reasons for quitting a job, some of them emotional. Follow these guidelines and you'll avoid making moves you'll later regret

By Andrew C. Oliver

Sep 3, 2015 8 mins

Careers IT Jobs

Are you a data hoarder? Hadoop offers little choice

Data governance is one of the toughest, dreariest problems in computing. Sadly, the tools offered with the major Hadoop distributions aren't really up to task

By Andrew C. Oliver

Aug 27, 2015 6 mins

Data Management Data and Information Security Hadoop

How Apache Ranger and Chuck Norris help secure Hadoop

The Hadoop ecosystem has always been a bag of parts, each of which needs to be secured separately -- at least they did need that, until Apache Ranger came to town

By Andrew C. Oliver

Aug 20, 2015 4 mins

Hadoop Security Software Development

The 7 most common Hadoop and Spark projects

Think you're breaking new ground with your Hadoop project? Odds are it fits neatly into one of these seven common types of projects

By Andrew C. Oliver

Aug 13, 2015 6 mins

Business Intelligence Data Management Hadoop

9 big data pain points

Do enough Hadoop and NoSQL deployments, and the same problems crop up again and again. It's time for the industry to nail them sooner rather than later

By Andrew C. Oliver

Aug 6, 2015 7 mins

Data Management Hadoop NoSQL Databases

Why streaming analytics is such a big deal

Analytics drive decisions, but some decisions shouldn't wait until batch processes complete -- which is why, eventually, we'll all analyze data as it streams in

By Andrew C. Oliver

Jul 23, 2015 4 mins

Business Intelligence Hadoop Software Development

Which freaking Hadoop engine should I use?

These four truths will help you determine which Hadoop technology to use for the types of workloads you anticipate

By Andrew C. Oliver

Jul 9, 2015 6 mins

Data Management Data Science Hadoop

Big data, big challenges: Hadoop in the enterprise

Fresh from the front lines: Common problems encountered when putting Hadoop to work -- and the best tools to make Hadoop less burdensome

By Andrew C. Oliver

Jul 2, 2015 5 mins

Data Management Hadoop PaaS

A new document database emerges from the cloud

The NoSQL trend has given us a crazy array of new database choices. Clusterpoint has just jumped in to offer a cloud-based document database

By Andrew C. Oliver

Jun 25, 2015 3 mins

Databases NoSQL Databases SaaS

Debunked! 9 myths about big data and Hadoop

These unfounded beliefs about budget skills, technology, and technology fit can lead you astray

By Andrew C. Oliver

Jun 18, 2015 5 mins

Data Science Data Visualization Hadoop

A better mousetrap: A JSON data warehouse takes on Hadoop

Sure, a NoSQL or JSON data warehouse sounds faddish, but SonarW is a better solution for many

By Andrew C. Oliver

Jun 11, 2015 4 mins

Business Intelligence Data Management Data Warehousing

MongoDB at the crossroads: Growth or openness?

MongoDB World 2015 introduces interesting new features in MongoDB 3.2 and more interesting questions about the future of the company and its community

By Andrew C. Oliver

Jun 2, 2015 9 mins

Databases NoSQL Databases Open Source

Learn data science and more with new and improved MOOCs

With recent enhancements, you can now get a truly useful education from Coursera and its ilk — in data science, machine learning, and many other subjects.

By Andrew C. Oliver

May 28, 2015 6 mins

Data Science Developer IT Skills

The mythical Hadoop skills gap

Oh no! Big data is failing because we can't find enough people who know the technology! Relax, they're out there -- but don't fall for the buzzwords

By Andrew C. Oliver

May 21, 2015 4 mins

Data Management Hadoop

Sick of ETL? Database virtualization can help

Database virtualization, a seemingly bad idea from the past, turns out to be a good idea in the present

By Andrew C. Oliver

May 14, 2015 4 mins

Data Management Hadoop Software Development

Apache Flink: New Hadoop contender squares off against Spark

A flexible replacement for Hadoop MapReduce that supports real-time and batch processing, Flink offers advantages over Spark

By Ian Pointer

May 7, 2015 6 mins

Data Management Hadoop

10 ways our data overlords could serve us better

Dear corporations: We've already ceded our privacy. Now implement the technology to serve us right

By Andrew C. Oliver

Apr 30, 2015 9 mins

Business Intelligence Data Mining Technology Industry

Machine learning and the strategic snake oil reserve

Outside of programmatic trading and fraud detection, we're only starting to use machine learning in business. The biggest inhibitor may be our lack of imagination in applying it

By Andrew C. Oliver

Apr 16, 2015 4 mins

Data Management Robotics Software Development

Big data is dead — long live big data

Soon, we'll see 'prepacked' applications that incorporate the distributed processing, machine learning, and analytics of today's overhyped, custom-made solutions

By Andrew C. Oliver

Apr 9, 2015 3 mins

Data Management Hadoop Robotics

Spark, big data’s brightest star, needs to grow up

Spark is the hottest project in big data -- but Databricks, the company behind it, needs to ensure its implementation has a plausible path to maturity

By Andrew C. Oliver

Apr 2, 2015 6 mins

Data Management Hadoop Software Development

Crunch data from your car for fun and profit

A $99 device and a Spark back end creates an ecosystem of car-connected data and applications

By Andrew C. Oliver

Mar 26, 2015 5 mins

Data Management Software Development Technology Industry

It came from the cloud: The looming change in IT

PaaS is finally getting traction, and when it takes hold, the lives of developers will change forever

By Andrew C. Oliver

Mar 19, 2015 4 mins

Cloud Computing PaaS Software Development

What you need to know about Hadoop right now

Ten months ago, we published a cheat sheet for learning about Hadoop, the center of the big data vortex. Check out what's been added since then

By Andrew C. Oliver

Mar 12, 2015 5 mins

Hadoop Robotics Software Development

3D printers: The next wave of robots

When combined with scanners, today's 3D printers do more than mold figurines out of plastic goop. They're closer to displacing a broad swath of everyday jobs than you think

By Andrew C. Oliver

Mar 5, 2015 5 mins

Software Development Technology Industry

What open data really means for government

The open data movement purports to cultivate an informed citizenry and rescue government offices from the dark ages -- but can it tell me which streets to avoid on my bike?

By Andrew C. Oliver

Feb 26, 2015 5 mins

Data Mining Software Development Technology Industry

What Pivotal’s big open source move really means

Now that Pivotal has partnered with Hortonworks and open-sourced Big Data Suite, the future of the business looks to be in Cloud Foundry's court

By Andrew C. Oliver

Feb 18, 2015 4 mins

Data Management PaaS Software Development

The Oculus Rift could change big data analytics forever

Data isn't the real world, it only describes it. A new company wants to let you drill past the numbers to lifelike, real-time representations of what's going on

By Andrew C. Oliver

Feb 12, 2015 5 mins

Analytics Data Management Robotics

First look: MongoDB 3.0, for mature audiences

The new MongoDB features document-level locking, better write performance, big memory support, and more. At last, MongoDB is all grown up

By Andrew C. Oliver

Feb 3, 2015 5 mins

Data Management NoSQL Databases Software Development

Build an IoT analytics solution with big data tools

The Internet of things seems futuristic, but real systems are delivering real analytics value today. Here's some real-world IoT advice from the field

By Phil Rhodes

Jan 29, 2015 9 mins

Business Intelligence Software Development Technology Industry

10 things you should worry about in 2015

We live in an age of uncertainty, where old assumptions suddenly become open questions. Generalized anxiety is bad for you, though, so focus on these 10 points

By Andrew C. Oliver

Jan 22, 2015 7 mins

Amazon Web Services PaaS Technology Industry

10 things you don’t need to worry about in 2015

We all have enough to worry about. Read this list and you'll have 10 fewer reasons to stay up all night

By Andrew C. Oliver

Jan 15, 2015 7 mins

Software Development Technology Industry

How to get a successful BI project off the ground

Establish the proper requirements, and you're halfway to a successful BI project. But gathering and rationalizing those requirements demands a rigorous approach

By Phil Rhodes

Jan 8, 2015 7 mins

Business Intelligence Software Development

Hands on: Build a Storm analytics solution

Storm lets you create real-time analytics for every conceivable need. Here's a tasty example using Twitter data and source code hosted on GitHub

By Phil Rhodes

Dec 18, 2014 18 mins

Analytics Data Management Hadoop

Show me more

Strategic Developer

Why Spark 1.6 is a big deal for big data

16 for ’16: What you must know about Hadoop and Spark right now

10 things to worry about in 2016

10 things you don’t need to worry about in 2016

Up close with Google’s Angular 2 JavaScript framework

We don’t need a million new Spark jockeys

5 things we hate about Spark

Joyent: The Docker-friendly cloud you’ve never heard of

Why client-server must die

All the cool companies are doing big data

9 developer trends you can bank on in 2016

NoSQL simply isn’t hip anymore

Why self-service is everything in BI and big data

6 takeaways from Cloudera’s embrace of Spark

Hadoop is slowly eating conventional analytics

Hadoop, in trouble? Only in Gartner-land

The big greenfield cannabis cloud

15 rules for quitting your job

Are you a data hoarder? Hadoop offers little choice

How Apache Ranger and Chuck Norris help secure Hadoop

The 7 most common Hadoop and Spark projects

9 big data pain points

Why streaming analytics is such a big deal

Which freaking Hadoop engine should I use?

Big data, big challenges: Hadoop in the enterprise

A new document database emerges from the cloud

Debunked! 9 myths about big data and Hadoop

A better mousetrap: A JSON data warehouse takes on Hadoop

MongoDB at the crossroads: Growth or openness?

Learn data science and more with new and improved MOOCs

The mythical Hadoop skills gap

Sick of ETL? Database virtualization can help

Apache Flink: New Hadoop contender squares off against Spark

10 ways our data overlords could serve us better

Machine learning and the strategic snake oil reserve

Big data is dead — long live big data

Spark, big data’s brightest star, needs to grow up

Crunch data from your car for fun and profit

It came from the cloud: The looming change in IT

What you need to know about Hadoop right now

3D printers: The next wave of robots

What open data really means for government

What Pivotal’s big open source move really means

The Oculus Rift could change big data analytics forever

First look: MongoDB 3.0, for mature audiences

Build an IoT analytics solution with big data tools

10 things you should worry about in 2015

10 things you don’t need to worry about in 2015

How to get a successful BI project off the ground

Hands on: Build a Storm analytics solution

Show me more

Databricks adds Data Science Agent to automate analytics tasks

Rust Innovation Lab launched, sponsors first project

PostgreSQL 18 to boost OLTP performance, but misses AI readiness

Getting encryption wrong (and getting it right, too)

How to build a native desktop app vs. a web UI app

PyApp: Build click-to-run Python apps with Rust