ibains

6 ms·

1.
by ibains 1y ago
Prophecy.io | Think Cursor for Data Analysts | US (onsite SF, remote) Prophecy is used by data engineers in the largest enterprises (SeriesB, $120M raised). Our new product for data analysts is agentic and multi-modal (docs, low-code, code
2.
by ibains 3y ago
Prophecy.io will be the way everyone does data transformation soon, just a zero compromise solution that beats legacy ETL and code by miles
3.
by ibains 3y ago
Yes, but in addition to being ACID compliant (serializable ANSI), you need to support a million transactions per second - it’s not just about data size.
4.
by ibains 3y ago
Why is this just not ETL, why do you need anything here? There is no new category or product needed here.
5.
by ibains 3y ago
That’s assuming you’re not using low-code. There are inbuilt connectors to read data, transform data, read/write to pinecone, make api calls to LLMs. It is much faster to prototype with Prophecy.io
6.
by ibains 3y ago
It is pointless - LlamaIndex and LangChain are re-inventing ETL - why use them when you have robust technology already? 1. You ETL your documents into a vector database - you run this pipeline everyday to keep it up to date. You can run sca
7.
by ibains 3y ago
Yes but this is just ETL - LlamaIndex and LangChain are re-inventing it - why use them when you have robust technology already? 1. You ETL your documents into a vector database - you run this pipeline everyday to keep it up to date. You can
8.
by ibains 3y ago
A lot of B2B startups can technically the cloud API to provide value added applications to Enterprises, but often the banks and healthcare companies will not want their data running through startups pipes to OpenAI pipes. We provide a low c
9.
by ibains 3y ago
Prophecy (prophecy.io) | ML Engineer | Palo Alto, CA Work on LLMs and Knowledge Graphs fir English -> ETL data pipelines You should have previous experience in NLP and solid programming. Shipping a project from scratch is important. If y
10.
by ibains 3y ago
https://www.prophecy.io/blog/announcing-prophecy-3-0-low-cod...
11.
by ibains 4y ago
are you serious? they invested in US Treasuries, the highest rated and the most conservative asset class. Banks are in the business of lending money to home buyers, etc - how is loaning to the US Govt. criminal? They have a cash crunch due
12.
by ibains 4y ago
Prophecy.io | Software Architect | Palo Alto, CA Expert in Spark, Spark internals or Expert in Query Compilers. Level variable (2-20 yrs exp), prefer 10+ years Prophecy.io | Data Engineer | Palo Alto, CA Expert in writing Spark code and run
13.
by ibains 4y ago
Prophecy.io | Customer Success Director | Palo Alto, CA We’re a game changing low-code data engineering platform, replacing ETL tools and modernizing the modern data stack. You know data engineering well, have excellent customer facing expe
14.
by ibains 4y ago
Its not public language, but at Risk Management Systems, I worked on Contract Definition Language- an external DSL for computable insurance, re-insurance contracts. This was used to simulate insurance losses when catastrophic events happen
15.
by ibains 4y ago
Thank god solving customer problems has taken over the tech-ceo job, starting with tech is usually a bad idea, even when it is innovative (crypto-ponzi as an example)
16.
by ibains 4y ago
Prophecy.io | Customer Success Lead | InPerson Palo Alto We have customers from midsize to Fortune 500 relying on us for Data Engineering. We’re building out our success organization to onboard, enable and guide the customers. We do have a
17.
by ibains 4y ago
Prophecy.io is hiring a technical content writer in our marketing org. Requires data engineering, spark knowledge, good communication and writing skills and desire to move toward product marketing - the most in demand skill right now! Base
18.
Prophecy SeriesA – Low-Code Data Engineering on Spark and Airflow(prophecy.io)
5 points by ibains 5y ago|0 comments
19.
by ibains 5y ago
We’re very different from the ETL tools in that we’re bring software development best practices to data. When you do visual drag and drop - prophecy is generating high quality code on git that is 100% open source (spark, airflow), you have
20.
by ibains 5y ago
Prophecy.io let’s you create visual components from any Spark function. Same with Airflow. So you can use standard components (built-in or your new ones) without being restricted. Founder here - we’re working to solve this exact problem.
21.
by ibains 5y ago
Our US based startup has engineering in India (20 engineers) and the biggest challenge is finding engineering leadership. It is hard to hire in the bay area, especially leaders who have experience shipping high quality products (systems), s
22.
by ibains 5y ago
Prophecy.io | Principal UX Designer | Palo Alto, CA ONSITE | Full-time Prophecy is a low-code data engineering product that provides a visual environment to design, deploy and manage data pipelines. We’re looking for our first UX designer.
23.
by ibains 5y ago
We work with many businesses that are larger (Fortune 500) and the T per pipeline is say 60 steps with 1200 columns at 10TB scale and uses multiple things not in SQL. They lookup object stores, lookup web services, use rocksdb, partitioning
24.
by ibains 5y ago
First, product-marketing is the most important skill in forming a company. You might get lucky without it, but success rate will be low.
25.
by ibains 5y ago
This post is good for learning, we have too many “systems“ developed in Java (Hadoop et al - I’m looking at you - you sluggish bugs in the rug), we need more programmers to learn C and build systems in it. Also, you can do this so much easi
26.
by ibains 5y ago
These are not flaws, but tradeoffs made by deliberate choice. I’ve worked on x64 and graphics compilers and this article should be skipped.
27.
by ibains 5y ago
We want software engineers who understand compilers and query optimizers and systems. This requires good theoretical foundations with solid engineering skills. It is extremely hard to get these. Most CS majors don’t know much CS - top grads
28.
by ibains 5y ago
Prophecy.io | Spark Solutions Engineer | US - Remote (some client travel) | $180k-$220k Represent Prophecy at our Fortune 500 customers. Help them migrate from legacy ETL products to Prophecy on Spark. Help them on-board and solve various u
29.
by ibains 5y ago
Our industry is doing quite well (If you leave the ad-economy out - basically Google/Facebook) Cloud computing, Open Source Software in commercially feasible way and so on. Tremendous growth and innovation is underway. We do have a pro
30.
by ibains 5y ago
I assume SaaS=SaaS-App like iPhone App. Because you can also build serious technology as SaaS.

More ›