Ask HN: Functional Design of a AWS Data Lake

2 points by ironfootnz ↗ HN
Working on the high level 30k feet from the ground is a easy job to do, I ask my fellow members of HN.

How do you specify the functional design of a datalake under aws cloud?

Here's my background.

I'm trying to implement a function to the zones in the lake: landing, raw, trusted and refined.

To get access to the zones I came up with a user community:

- General users - Employees - Data People (scientist, analysts) - Third-party SasS - Partners

As I'm considering AWS Cognito to manage the policies around the user pool, I strugle setting the policies for each group and individual, they always endup overlapping.

How did you guys sort that out? Can you share your views, thoughts a link that I can read better into the functional details?

1 comment

[ 1.8 ms ] story [ 9.6 ms ] thread
Would love to see answers on this as a relative noob with the framework.