![](\"\/wp-content\/uploads\/2015\/09\/Aqueduct.jpg\")
<\/p>\n<\/p>\n
Earlier this week, our founder Prat authored an article on InsideBigData<\/a> about planning for data lakes. He shared five big questions to consider. Experience tells us this is necessary. Far too many people jump into data lakes hastily, and not just as a justification to overuse water-related puns. It\u2019s more often an excuse to splash around with Hadoop, which is an understandable impulse given all the hype. But three months into it, teams are often drowning, and worse, not delivering value. That\u2019s why earlier this year a brow-raising research note on data lakes from Gartner, Inc.<\/a> stated: Part of the difficulty may be operational or cultural. But companies also face major technical barriers. It\u2019s hard to move workloads from discovery-oriented data lakes into production-grade systems. Subsets of data may need to flow to your data warehouse, or new workloads may need an operational data mart. Teams must construct data lakes with the expectation that data discoveries will regularly move to other systems. That’s a good thing! Start with the assumption that you will make many useful discoveries. If you don’t think that…why are you building a data lake in the first place? Earlier this week, our founder Prat authored an article on InsideBigData about planning for data lakes. He shared five big questions to consider. Experience tells us this is necessary. Far too many people jump into data lakes hastily, and not just as a justification to overuse water-related puns. It\u2019s more often an excuse to splash […]<\/p>\n","protected":false},"author":9,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[5],"tags":[45,46],"class_list":["post-2454","post","type-post","status-publish","format-standard","hentry","category-blog","tag-bi-analytics","tag-technical"],"_links":{"self":[{"href":"https:\/\/cazenasite.com\/index.php?rest_route=\/wp\/v2\/posts\/2454","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/cazenasite.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/cazenasite.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/cazenasite.com\/index.php?rest_route=\/wp\/v2\/users\/9"}],"replies":[{"embeddable":true,"href":"https:\/\/cazenasite.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=2454"}],"version-history":[{"count":0,"href":"https:\/\/cazenasite.com\/index.php?rest_route=\/wp\/v2\/posts\/2454\/revisions"}],"wp:attachment":[{"href":"https:\/\/cazenasite.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=2454"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/cazenasite.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=2454"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/cazenasite.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=2454"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}
\n
\n\u201cThrough 2018, 90% of deployed data lakes will become useless as they are overwhelmed with information assets captured for uncertain use cases.\u201d <\/em>
\n
\nHence Prat\u2019s emphasis on the importance of planning. But even those who plan have faced a consistent water hazard, outlined succinctly by Gartner:
\n
\n\u201cBuild a technology pipeline and organizational structure for moving discoveries out of the data lake. Discoveries made in the data lake often can’t stay there.\u201d <\/em>
\n
\nThis is a critical point. Long before big data and data lakes, analytics suffered from silos. As a tech reporter over a decade ago, I heard repeatedly that the biggest challenge for business intelligence and analytics programs was not the software or data (though those are hard.) It was getting organizations to effectively use the insights uncovered by analytics projects. In many enterprises, the problem persists.<\/p>\n
\n
\nArchitecting a data lake is challenging, but Cazena has you covered in two ways \u2013 whether you plan to build or buy.
\n
\nBuild: If you want to DIY with Hadoop, Prat will be giving a tutorial at Strata Hadoop World next week. \u201cBuilding a Production-ready Data Lake in the Cloud\u201d<\/a> includes lots of useful information, and a section on data movement. We gained lots of experience here, we\u2019ll have our techies present, and we won\u2019t hold back.
\n
\nBuy: Consider Data Lake as a Service<\/a> from Cazena, which includes data movement and tool connectors, and have the project done in days. Leaving plenty of time to go fishing, swimming or whatever other water-related recreational activity you prefer!<\/p>\n","protected":false},"excerpt":{"rendered":"