Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Full vs. Incremental Loading #13

Open
amigotune opened this issue Jan 7, 2016 · 2 comments
Open

Full vs. Incremental Loading #13

amigotune opened this issue Jan 7, 2016 · 2 comments

Comments

@amigotune
Copy link

Hi!

It's not clear to me if Square does incremental or full loads. Is it able to do incremental ones? Where can I find more information about this?

Cheers!

@jeffreyiacono
Copy link
Collaborator

hey @amigoricardo happy to help answer your question, but wanted to make sure I understand it a bit more: are you asking if you can use this framework to do data processing that continues to build from a given starting point or if you need to do a complete rebuild each time? We've used this to do both and the amount of data and destination structure has really been the deciding factor in picking one set up over the other. Let me know!

@amigotune
Copy link
Author

Hi! I want to sync two tables according to a specific query. Thus, I would like to Square to identify, at each run, the minimum amount of UPDATEs, INSERTs and DELETEs in order to sync them.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants