Basically I need to take data from mysql, transform it, and import it into elasticsearch. The transformations I need to do are quite basic; for instance, taking the first 155 chars of the existing Head Note and creating a string for an Html Meta Description. I have some good tools to go from MySQL to XML, but I don't know if that helps anything.
I've been looking around for an hour or so and can imagine several potential paths. Perhaps there are better ones out there too.
- Create XML from MySQL. Use logstash (if possible?) to transform and import into Elasticsearch.
 - MySQL to XML. Create XSLT file to restructure data. Generate XML and somehow import into ES.
 - MySQL to XML. Create XSLT file to restructure data. Generate JSON and somehow import into ES.
 - Use river-jdbc plugin to import from MySQL, IF I can also join tables and transform data.
 - Other?
 
What would be an efficient way to import my data?
No comments:
Post a Comment