A Pattern Language for Deep Learning

A Pattern Language for Deep Learning

Pattern Languages are languages derived from entities called patterns that when combined form solutions to complex problems. Each pattern describes a problem and offers solutions. Pattern languages are a way of expressing complex solutions that were derived from experience such that others can gain a better understanding of the solution. Pattern Languages were originally promoted by Christopher Alexander to describe the architecture of businesses and towns. These ideas where later adopted by Object Oriented Programming (OOP)practitioners to describe the design…

Read More Read More

Microglia: A Biologically Plausible Basis for Back-Propagation

Microglia: A Biologically Plausible Basis for Back-Propagation

The Perceptron, the basis of Artificial Neural Networks (ANN), was conceived in 1957: It is of course an outdated model of how the neurons actually work.  The current neural network research and development is more driven by mathematically techniques that ensure continuity and convergence rather than anything biological inspired. However there are other research groups like Numenta and IBM TrueNorth that are investigating more biologically inspired systems.   These systems are referred to as “Spiking Neural Networks (SNN)” (see: https://en.wikipedia.org/wiki/Spiking_neural_network )…

Read More Read More

The Emerging Information Geometric Approach to Deep Learning

The Emerging Information Geometric Approach to Deep Learning

Classical Statistics addresses systems involving large numbers, however Statistics breaks down in a domain of high dimensional inputs and models with a high number of parameters. In this domain, new theories and methods are being developed using new insights discovered though the use of massive computational systems. The field of Deep Learning is spearheading these discoveries, however there is a pressing need to have an overarching framework. Such a framework is at the core of our development efforts at Alluviate….

Read More Read More

The Seven I’s of Big Data Science Methodology

The Seven I’s of Big Data Science Methodology

Industry press is enamored by the 4 V’s of Big Data. These are Volume, Velocity, Variety and Veracity. Volume referring to the size of the data. Velocity referring to the speed of how data is collected and consumed. Variety referring to the different kinds of data consumed, from structured data, unstructured data and sensor data. Veracity referring to the trustworthiness of the data. IBM (source) has a nice infographic that highlights the problem space of Big Data: Readers however are…

Read More Read More

Data Lakes and the Responsive 21st Century Corporation

Data Lakes and the Responsive 21st Century Corporation

Yammer’s founder is introducing a new way of organizing the corporation. His ideas originate from earlier ideas from the Lean and Agile methodologies of software development. In his Responsive Manifesto he drives a case for a new kind of efficiency that will drive the successful workplaces of the future. In a article “How Yammer’s Co-founder Impressed Bill Gates“: Flash forward to 2015, when the future is more unpredictable than ever. The connectivity we’ve achieved over the last decade has changed…

Read More Read More

Data Lakes – Salvation from Data Integration Complexity?

Data Lakes – Salvation from Data Integration Complexity?

I’ve been in the IT industry for 20 years and have encountered all too many proposals to solve the enterprise’s data integration nightmare. In the early 90’s there was an book with an intriguing title. Orfali and Harkey had been publishing a series of books that had cartoonish aliens on the cover. They had a book called “The Essential Distributed Objects Survival Guide”, which apparently won the 1996 software productivity award. In this book, you will find wild claims about…

Read More Read More

Alluviate – The Origin of the Word

Alluviate – The Origin of the Word

The Merriam Webster dictionary includes an adjective: alluvial adjective al·lu·vi·al \ə-ˈlü-vē-əl\    geology : made up of or found in the materials that are left by the water of rivers, floods, etc. a noun: alluvion noun al·lu·vi·on \ə-ˈlü-vē-ən\ 1 :  the wash or flow of water against a shore 2 :  flood, inundation 3 :  alluvium 4 :  an accession to land by the gradual addition of matter (as by deposit of alluvium) that then belongs to the owner of the land to which it…

Read More Read More