Apache Spark: A Unified Engine for Big Data Processing

@tachyeonz : Communications of the ACM, Vol. 59 No. 11, Pages 56-65 10.1145/2934664 This open source computing framework unifies streaming, batch, and interactive big data workloads to unlock new applications.

Click here to read more

Tags : #bigdata, #distributedcomputing, #streamprocessing, apache spark, m

Published On:November 11, 2016 at 12:00PM

Connect On:
Facebook : /tachyeonz
Twitter :@tachyeonz

Top Resources if you want to work as a Data Scientist for the CIA

@tachyeonz : Ever wanted to work in security intelligence area & use your data science chops? Here are top resources to help get started working for the CIA

Click here to read more

Tags : #bigdata, #career, #cia, #dataanalytics, #datavisualization, #employement, #job, #machinelearning, #statistics, m

Published On:December 06, 2016 at 06:35PM

Connect On:
Facebook : /tachyeonz
Twitter :@tachyeonz

Examine data collection problems with big data, IoT in mind

@tachyeonz : Distributed databases are funny in that they are distributed.

Click here to read more

Tags : #bigdata, #cloud, #dataacquisition, #iot, m

Published On:December 07, 2016 at 07:06AM

Connect On:
Facebook : /tachyeonz
Twitter :@tachyeonz

CIA Chief Tech Officer: Big Data Is The Future And We Own It

@tachyeonz : On Wednesday, the CIA’s chief technology officer detailed the Agency’s vision for collecting and analyzing all of the information people put on the Internet.

Click here to read more

Tags : #ai, #bigdata, #cia, #datascience, #datavisualization, #employement, #job, #machinelearning, #nsa, #pentagon, #pentesting, m

Published On:December 06, 2016 at 10:03PM

Connect On:
Facebook : /tachyeonz
Twitter :@tachyeonz

Economists are prone to fads, and the latest is machine learning

@tachyeonz

@tachyeonz : WHAT is the collective noun for a group of economists? Options include a gloom, a regression or even an assumption. In January, when PhD students jostle for jobs at the annual meeting of the American Economic Association, a “market” might seem the mot juste.

Click here to read more

Tags : #bigdata, #deeplearning, #fad, #hype, #machinelearning, m

Published On:December 05, 2016 at 07:34PM

Connect On:
Facebook : /tachyeonz
Twitter :@tachyeonz

Dataflow: A Unified Model for Batch and Streaming Data Processing

@tachyeonz : Unbounded, unordered, global-scale datasets are increasingly common in day-to-day business (e.g. Web logs, mobile usage statistics, and sensor networks). At the same time, consumers of these datasets have evolved sophisticated requirements, such as event-time ordering and windowing by features of th

Click here to read more

Tags : #apachebeam, #bigdata, #dataflow, #frameworks, #google, m

Published On:November 30, 2016 at 09:57PM

Connect On:
Facebook : /tachyeonz
Twitter :@tachyeonz

How I Learned To Love Statistics — And Why You Should, Too

@tachyeonz : Recently though, I’ve had a change of heart about the subject. In response, I find statistics changing my mind, or at least changing my perspective. Let me explain.

Click here to read more

Tags : #bigdata, #coursera, #standarddeviation, #statistics, m

Published On:November 25, 2016 at 09:38PM

Connect On:
Facebook : /tachyeonz
Twitter :@tachyeonz

The Perfect Big Data Platform — My Blueprint

@tachyeonz : Some time ago I have created a simple and modular big data platform blueprint for myself. It is based on what I have seen in the field and read in tech blogs all over the internet. Today I am going to share it with you.

Click here to read more

Tags : #batchprocessing, #bigdata, #kafka, #platform, #streamprocessing, m

Published On:November 12, 2016 at 09:31PM

Connect On:
Facebook : /tachyeonz
Twitter :@tachyeonz

When Big Data, Iot and Geospatial Technology Collide

@tachyeonz : Geospatial intelligence is ingrained in our daily lives.

Click here to read more

Tags : #bigdata, #geospatial, #iot, m

Published On:November 11, 2016 at 03:21PM

Connect On:
Facebook : /tachyeonz
Twitter :@tachyeonz

Apache Spark: A Unified Engine for Big Data Processing

@tachyeonz : Communications of the ACM, Vol. 59 No. 11, Pages 56-65 10.1145/2934664 The growth of data volumes in industry and research poses tremendous opportunities, as well as tremendous computational challenges.

Click here to read more

Tags : #apachespark, #bigdata, #distributedcomputing, #streamprocessing, m

Published On:November 11, 2016 at 12:00PM

Connect On:
Facebook : /tachyeonz
Twitter :@tachyeonz

Personalization Comes to Retail with Big Data, IoT and Augmented Reality

@tachyeonz : Every customer is unique — so why are so many customer experiences identical? We’ve been told that we are special ever since we were little, but how special are we? I challenge you to find another person in the world that is exactly like you. That person probably doesn’t exist.

Click here to read more

Tags : #ar, #bigdata, #internetofthings, #iot, #retail, m

Published On:November 10, 2016 at 10:59PM

Connect On:
Facebook : /tachyeonz
Twitter :@tachyeonz

Untangling algorithmic illusions from reality in big data

@tachyeonz : Microsoft principal researcher Kate Crawford (@katecrawford) gave a strong talk at last week’s Strata Conference in Santa Clara, Calif. about the limits of big data.

Click here to read more

Tags : #algorithms, #bigdata, #deeplearning, #machinelearning, m

Published On:November 06, 2016 at 10:15AM

Connect On:
Facebook : /tachyeonz
Twitter :@tachyeonz