1. DotNet

• Kafka dotnet client: https://github.com/confluentinc/confluent-kafka-dotnet

This is an example of a very simplified insurance sales system made in a microservice architecture using:

• .NET Core 2.1
• Entity Framework Core
• MediatR
• Marten
• Eureka
• Ocelot
• JWT Tokens
• RestEase
• RawRabbit
• NHibernate
• Polly
• NEST (ElasticSearch client)
• Dapper
• DynamicExpresso

2. Java

3. DevOps

• Docker: https://hub.docker.com/r/kianzhou/github-radar

4. Data Model

Storing objects (think{JSON}object)

• Schemas - Custom Domain Model
• Streams - Conversions & Previews
• Security - Security Policies
• Search - on any field
• Audit - Application Log (save audit trail in PostgreSQL)

5. Samples

5.0 Repository & Storage Adapters

5.1 Elastic Stack

5.1.2 Structure1

5.1.3 Structure2

5.1.4 ES Solution

• File System also can be save in S3 (S3 Binary Manager)
• Google Drive & Google Doc integration
• Search - Elastic
• Storage/Import - MongoDB
• Aync processing - Redis

5.1.5 ES Search

• Simple search
• Faceted search
• Listings and views
• Suggestion widgets

5.1.6 ES + MonogoDB / Redis

• elasticsearch
• redis

• Ecosystem:

  Cluster + MongoDB ReplicSet + ElasticSearch + Redis + Kafka + Zookeeper

• Offload queries from DB - decouple sizing of searching & storage
• performance & scalability

5.2 Kafka

5.2.1 Kafka + Redis

• QUeue Messages/Actions instead of Jobs
• Minimize redis persistence

• Optimize processing

  • pre-process messages (Audit)
  • regroup/batch some updates

Nouns:

• BFF: Backend for Frontend
• PaaS: Platform as a Service
• ELKB
• SOA: software architecture.
• coarse-grained: fine-grained

TODOs:

• any 3rd high-level libaries ?