Welcome to OGeek Q&A Community for programmer and developer-Open, Learning and Share
Welcome To Ask or Share your Answers For Others

Categories

0 votes
515 views
in Technique[技术] by (71.8m points)

amazon web services - Using AWS glue schema registry with confluent SerDe clients

For supporting schema registry on my MSK topic, I found two options -

  • AWS Glue Schema Registry; and
  • Confluent Schema Registry

Since, Glue SR is fully managed by AWS, I would prefer to use that. However, my producer and consumer clients are written in python, which limits me from using SerDe libraries provided by AWS in java.

I went on to search whether the confluent schema registry API (part of confluent kafka library in python) can be made to work with the Glue Schema Registry, since my initial assumption is that the schema registry implementations are generic across confluent and glue.

When reading confluent documentation, I found that a schema registry connection can be established by supplying url for schema registry using url property (https://docs.confluent.io/platform/current/clients/confluent-kafka-python/#).

I cannot find such url for the glue registry I created. Their java client does take in properties like region name, registry name and other properties (https://docs.aws.amazon.com/glue/latest/dg/glue-dg.pdf#schema-registry). Is there any way this url can be found out, or should I switch to confluent SR, which is not a managed service?

question from:https://stackoverflow.com/questions/65930551/using-aws-glue-schema-registry-with-confluent-serde-clients

与恶龙缠斗过久,自身亦成为恶龙;凝视深渊过久,深渊将回以凝视…
Welcome To Ask or Share your Answers For Others

1 Reply

0 votes
by (71.8m points)
Waitting for answers

与恶龙缠斗过久,自身亦成为恶龙;凝视深渊过久,深渊将回以凝视…
OGeek|极客中国-欢迎来到极客的世界,一个免费开放的程序员编程交流平台!开放,进步,分享!让技术改变生活,让极客改变未来! Welcome to OGeek Q&A Community for programmer and developer-Open, Learning and Share
Click Here to Ask a Question

1.4m articles

1.4m replys

5 comments

57.0k users

...