Tim Bauer’s Running Thoughts

Semi-daily webcast summaries/insights

Jeff Bezos (AMZN): Psst. Buddy. Want a Server? (AWS)

My life, as of late, is Amazon Web Services (AWS).

You see, my current client has me running their migration onto the AWS stack leveraging the AWS services around FPS, Customer, and Credit Card Management. So, I hadn’t been motivated to watch discussions on it … but when 2-3 people emailed me articles around AWS this week as fodder for the blog … I figured it was a sign.

So, as usual my raw notes are below, but here are the thoughts that jumped out at me as I ran (i.e. jogged) along.

Details Notable Points
Title/Link:

Duration:

  • ~45m

Speakers:

Recommend to Watch? Yes

  • The best part of this presentation was Jeff’s quick shift to Q&A. He spent 10 minutes overviewing AWS and then took questions for 30. The questions were excellent and off the beaten path.
1. Is that “RED” line really red … or more yellow?

  • While I am not a doubter that AWS isn’t seeing a huge uptake in usage the stats they are using to prove it are rather interesting. Bandwidth? What might be more interesting is instances running or # of service calls made. Reality is that S3 is a large chunk of that growth as many customers are using it for large file storage. It takes A TON of transactions to equal the movement of 1 big video file or image and file storage isn’t that eye opening. Lets see the states on instances and/or service calls.

2. That jab aside, AWS is the best I see right now for Enterprise Customers …

  • The recent release of Elastic IP Addresses + the ability to soon have persistent storage make it viable to start thinking maybe 09 to pilot actual production applications running at AMZN (granted low risk apps to start). If you still don’t want to put 100% of an application out on their gear, unlike Google’s GAE, you can choose how much or how little you use of their stack.

3. More on the power of choice AMZN gives you

  • You can look at your app and chunk out pieces of the infrastructure like storage (S3), queues, or the servers themselves. Even more interesting is what they are in pre-release on … services to allow aspects of your systems to be hosted with them. Your customer records, credit card records (no liability of a leaky credit card security model), product, orders, payment processing, warehousing systems. All at a granular service level (not an application). Roll your own. Something to ponder for 09 or 2010 as I suspect it will stabilize later this year or early next.

So while the AMZN AWS offering has been focused on solving spike CPU usage problems for clients for the most part up till now (like running massive models over night) I suspect they are close to stabilizing an offering for those 7X24 applications (yes, I know you can kinda do it today). Bezo’s comment around package vendors assessing hosting models w/ AMZN where images of servers running their gear can be rented was an example of this (think of a server running MSFT Office or Photoshop when you need it across all your various PCs).

** START OF RAW SCRIBBLE TAKEN WHILE RUNNING **

• http://omnisio.com/startupschool08/jeff-bezos
• 4/23/2008, 6:12 AM
• Bandwidth charts
…………….○ Blue line (AMZN)
…………….○ Red line (bandwidth w/ AWS)
…………………………..§ BAUER COMMENT - S3 could skew that #, service call metrics would be more interesting
• Offerings
…………….○ AWS
…………….○ S3
…………….○ Ec2
…………….○ Simpledb
…………….○ Sqs
…………….○ Fps
…………….○ Mechnical turk - get pieces done manually by work queues amzn enables
• 4/23/2008, 6:14 AM
…………….○ Goals - easy, fast, elastic, highly avail, pay by drink
• S3
…………….○ 18B objects in S3
…………….○ Double in 2 years in AWS developers (370k)
• Why are people excited
…………….○ Shows picture of electric power generator
…………………………..§ BAUER COMMENT - similar story to Big Switch book
…………….○ How people did electric by themselves
…………….○ How to … Go from idea to product … quickly …
…………….○ Costs of doing data center - server, contracts, bandwidth, purchasing, facilities, scaling, etwork, heterogeneous, legacy, large teams
…………….○ Vision releases occur over and over
…………….○ AMZN helps with the above
• 4/23/2008, 6:19 AM
• Examples who are using
…………….○ NY Times took archives back to 1851 (4 TB) to PDF
…………………………..§ AMZN provided virtual server for one time batch
…………………………..§ AMZN provided S3 to serve articles
…………………………..§ Search for computer 1892 reference …. Was a job type
…………….○ SanDisk
…………………………..§ USB drive w/ auto backup to S3
…………….○ Animoto
…………………………..§ Royalty free music + videos … program listens to music and auto edits photo and tweens to align … then you can regen till you like it
…………………………..§ Queue, s3, ec2 used
…………………………..§ Viral facebook … over 3 days ramps to 3500 server instances
…………………………………………□ BAUER COMMENT - KEY FOR VIRAL APPS, ? ON NEED FOR SLOWER ADOPTION MODELS
…………………………..§ Talk to graph of growth and how ec2 can spin up/down instances based on load (tailoring cost as you go)
…………………………..§ BAUER THOUGHT - TITLE - AMZN, MOVERS NEEDED
• 4/23/2008, 6:27 AM
• End point
• AMZN - They make electricity so you don’t have to
• Q&A
…………….○ 4/23/2008, 6:28 AM
…………….○ How did AWS idea get started?
…………………………..§ 4 yrs started idea
…………………………..§ Launch 1st service 2 yrs ago
…………………………..§ Internal issue 1st, abstracting apps teams from infra team internally
…………………………………………□ BAUER THOUGHT - MAKES SENSE FROM WHAT I SEE AT CURRENT GIG (WAY THEY ARE WRITTEN, ETC)
…………………………..§ Didn’t expect this level of traction this early
…………………………..§ 4/23/2008, 6:32 AM (restart, omnisio dropped)
…………………………..§ New customer set … buyers, sellers, and now (new) developers
…………….○ 4/23/2008, 6:33 AM
…………….○ Concerns around service interruption that happened 2 months back. How handle. How do people respond. Hard to get off gear?
…………………………..§ Low friction to switch off platform, no contracts.
…………………………..§ API’s simple … easy to switch
…………………………………………□ BAUER COMMENT — IT CAN BE PIECEMEAL
…………………………..§ Low latency, cost
…………………………………………□ BAUER COMMENT — Agree on the 1st point being a key in this arch. Working on that now. Roundtrips in system design are the key … not a specific interface latency. Logical unit of work
…………………………..§ Main change they made for up time
…………………………………………□ Improve communication around outtage or brown out
…………………………………………□ Goal is 100 Up (TP100)
…………….○ 4/23/2008, 6:37 AM
…………….○ Customer serving hospitals. Can’t provide AMZN due to patriot act if cross boundries. Where data resides.
…………………………..§ EU has data rules (medical data no cross borders)
…………………………..§ Availability zones is one answer (choose where you host globally)
…………………………………………□ Fault tolerant
…………………………………………□ Address data location (today all in US, expand globally)
…………….○ 4/23/2008, 6:39 AM
…………….○ Runs rails apps on AWS, spammers are ruining IPs
…………………………..§ Doesn’t know the answer
…………………………..§ Static IP solution (elastic IP) can solve the problem (but requires additional server) allows the external world to see a consistent IP
…………….○ 4/23/2008, 6:40 AM
…………….○ Hosting needs stable, EC2 pricing <> to traditional server hosting in a data center (like rackspace)
…………………………..§ He doesn’t agree
…………………………..§ Might be anomalies today … but goal is to be the low cost provider to customers
…………………………..§ Instance sizes may get more granular (they price by cpu power, etc in instance)
…………….○ 4/23/2008, 6:42 AM
…………….○ Whats it like to launch a rocket? (personal question to him)
…………………………..§ He Is funding a company for a trip to sub orbit … blue orbital … lands on tail like buck rogers
…………………………..§ 1st dev vehicle done
…………………………..§ 2nd in process
…………………………..§ One more after that
…………………………..§ Then take public
…………………………..§ Are a ec2 customers … do aerodynamic models on ec2 cloud …
…………………………………………□ BAUER COMMENT - Another example of high volume spike processing … keep in mind elastic IP offering came just in last 3-4 week … coupled with movement to attached storage drives to an instance …. so ability to host stable apps over time being viable for enterprise is new (granted you could hack it together).
…………….○ 4/23/2008, 6:45 AM
…………….○ Thoughts on Google’s offering
…………………………..§ They don’t talk about other companies
…………………………..§ They innovate more by focusing on the customer not the competitor
…………………………..§ That is why they have their policy
…………………………..§ AWS is unique is that its deep in the stack. API’s exposed like storage, queues,
…………………………………………□ BAUER COMMENT - Also services payment, customer, product, orders, checkout, etc
………………………….§ Give people control on knobs on sophis applications
…………………………..§ Not a winner take all space … there will be a lot of winners
…………………………..§ Rare for notable change to be driven by one company … so customers will find many
…………………………..options.
…………….○ 4/23/2008, 6:48 AM
…………….○ AWS Shared Infrastructure, can’t control spikes on ’shared’ infra … what if 10-100 customers go viral … others get impacted … how resolve
…………………………..§ Key question is how to manage risk
…………………………..§ Key is better than alternative (up time @ shared is better than internal) … inability to handle spikes .. Turn the question around .. How does your business handle spikes
…………………………..§ By aggregation … Pool is large can handle … so built for far larger spikes
…………………………..§ They manage averages of all AWS dev pool
…………………………..§ Insurance company example
…………………………..§ Onus on them to prove they can consistently scale and spin up/down servers … what is satisfaction rating
…………….○ 4/23/2008, 6:52 AM
…………….○ SLA promise from AMZN
…………………………..§ Not right now but they could look into it
…………….○ 4/23/2008, 6:53 AM
…………….○ Thoughts of spinning up a ERP instance … fully running
…………………………..§ He is talking about configured servers … license on go
…………………………..§ Vendors creating an AMI to run their stuff for awhile … servers setup
…………………………..§ BAUER COMMENT - Note that is somewhat available by the ERP vendors today
…………………………..§ BAUER COMMENT — Enables a ondemand sell model for vendors
…………….○ 4/23/2008, 6:55 AM
…………….○ Vendor able to sell hosted model to companies that ran internal in the past
…………………………..§ Yes, audit is key for the customer
…………………………..§ Application changes … encrypt data prior to storage
…………….○ 4/23/2008, 6:56 AM
…………….○ How is AWS going to enable the mobile platform
…………………………..§ They can see the mobile devices taking up share on their browser market
…………………………..§ So you will see more AWS tied focused on AWS
…………………………..§ BAUER COMMENT - They bought TEXT BUY to cover this (payment device like paypal via mobile phone)
…………….○ 4/23/2008, 6:57 AM
…………….○ 100 Domain limit on simpleDB. When lift?
…………………………..§ Not clear. Validating things.
…………………………..§ Exceptions could be handled by a call to them
…………………………..§ Availability is their priority #1
…………………………..§ Adam Slipsky (contact him)
…………….○ End

** END RAW SCRIBBLE TAKEN WHILE RUNNING **

April 23, 2008 Posted by bauertim | 2-Perhaps (what floats your boat?) | , , , | 2 Comments

David Heinemeier Hansson: Forget Free, Go Fee

For those not tracking the geek world, David Heinemeier Hansson is a rather successful coder that built some well adopted apps (e.g. Backpack) and a framework that got some people excited about its ease (Ruby on Rails).

O.k. So what …

Well, DHH went on a rant about how the new business model of FREE that everyone is jumping up and down about. Specifically saying how it was nuts. In his view, “real” business startups (not those looking to get bought by some big fish) should focus on bringing value that customers pay for … not how they can be free and gain adoption from that.

Novel thought … but why is he pointing this out?

As usual my raw notes are below, but here are a few key themes that jumped out me as I watched this webcast over lunch

Webcast Details Notable Points

Duration:

  • ~40m

Speaker:

  • DHH (see link above)
    • Partner @ 37 signals (consulting firm based in CHI). Force behind Ruby on Rails and apps like Basecamp.

Recommend to Watch? Yes.

  • DHH always does a good job w/ slide structure and making the flow of his points (with a bit of shock jock foul mouth thown in). Worth the listen just for that.
1. Free. Fee. Why should you care?

  • David points out an interesting trend in industry. The movement toward free. Recently there was a hoo hah when Google offered an application for free that was just like one David’s company sells on a per month basis called Campfire. I guess that got David thinking about this free versus fee model. You should care because anything you do for free could be the next ‘free’ offering from one of the big boys. What to do?

2. What can you do? Nothing.

  • Momentum is just increasing for free services. The bar only gets lower now that Amazon is offering a cheap hosting model via AWS and Google is offering the free Google App Engine. If you can host and scale for pennies on the dollar … you can’t count on infrastructure for a barrier to entry.

3. O.k. I lied. David Pointed Out Niche As The Answer.

  • David’s solution was focusing on a niche product that you sign a set of dedicated enterprise (not consumer, too fickle) clients to for monthly / yearly offerings. Free solutions will come but will struggle to get marketing to the niche. Its the broadly consumed offerings that will have to fight potentially face pressure on the ‘free’ front consistently.

In summary, gotta give hops to DHH for pointing out the frenzy in business today to launch businesses based on models that are not clear (just build membership) especially in a setting where VC’s are presenting before him. I think he is right to call for a refocus at the individual level especially as he talked about focusing on a niche and delivering to that niche. Much like the line Security through Obscurity … you can protect your business concept by starting small in niche markets. If you go after the mega models (like the next FriendFeed … you have big fish to swim with and will likely get eaten).

** START OF RAW SCRIBBLE TAKEN WHILE RUNNING **

http://omnisio.com/startupschool08/david-heinemeier-hansson-at-startup-school-084/21/2008
11:40 AM
……………○ 4/21/2008, 11:41 AM
…………………………§ 37 signals
………………………………………□ Not hiring
………………………………………□ Not looking for VC $
………………………………………□ Makes them different than most businesses
…………………………§ Their focus - how to be viable outside of big dogs getting bought out
…………………………§ New focus - Don’t focus on the $
……………○ 4/21/2008, 11:43 AM
……………○ A secret to making $ Online
…………………………§ Great application
…………………………§ ???
…………………………§ Profit
……………○ ??? = Price is key
……………○ Point is web 2.0 thinks everything is free … not true
…………………………§ BAUER COMMENT - BASECAMP and their model is paid … so his point is VC $ makes free ok
……………○ Simpler way to build a business
…………………………§ Have a price
…………………………§ Signup
…………………………§ Working 4-5 years … multi-million $ business
……………○ 4/21/2008, 11:45 AM
……………○ Shows campaign monitor (email service, track who clicks on what)
…………………………§ $0.01 per recipient
……………○ 4/21/2008, 11:46 AM
……………○ Shows FogBugz
…………………………§ On Demand
…………………………§ Buy the software
……………○ Show FaxItNice
…………………………§ Route around the fact that many businesses work w/ fax
…………………………§ Wrap it to a nice webservice
…………………………§ Pricing options
………………………………………□ $5 per fax,
………………………………………□ $20 retainer then a per send
………………………………………□ Send and receive faxes monthly
……………○ 4/21/2008, 11:47 AM
……………○ Not rocket surgery
…………………………§ Still hard but easier
…………………………§ Most businesses fail
………………………………………□ So why not try to be the next Google
…………………………§ Bad logic in his view
………………………………………□ Odds are not the same for barn burner … odds for a small niche product is better
…………………………§ Odds
………………………………………□ 1:10 is not facebook creation odds
………………………………………□ Example of relevance
……………………………………………………® 1:10 of making a million $
……………………………………………………® 1:10,000 for a billion $ business
…………………………§ Take better odds at smaller reward 1st … then go for the moon as the change in lifestyle from 0 to $1M and $1M to $1B is notable (the latter being small)
……………○ 4/21/2008, 11:52 AM
……………○ Example
…………………………§ 2000 customers
…………………………§ $40/month
…………………………§ 12 months
…………………………§ $1M year
…………………………§ 40,000 signups on trail … 5% conversion … 110 a day
…………………………§ …
…………………………§ What if you were happy @ $200k / yr = 400 customers @ $40/month
………………………………………□ BAUER COMMENT SO IT GETS EASER
……………○ 4/21/2008, 11:54 AM
……………○ Finding customers
…………………………§ Backpack
………………………………………□ Hard to get consumer to get people to pay
………………………………………□ Hard to establish business w/ that segment (consumer)
………………………………………□ Relaunch backpack 2 months ago … doubled the revenue by focusing on businesses
…………………………§ The Fortune 5,000,000
………………………………………□ The lifestyle business (mom & Pop store?)
………………………………………□ People make fun of that but he calls BS
………………………………………□ There is a lot of room in between
……………○ Craigslist
…………………………§ Without taking VC $ allows you to make the shots
…………………………§ Run @ your pace
…………………………§ $1M / yr … like no meetings
…………………………§ So its satisfying to not go for the brassring
…………………………§ Craig Newmark - $1B people are not happier
……………○ Good cause is incredibly hard and time consuming
…………………………§ Why flip business?
…………………………§ Enjoy it over 20 years
…………………………§ He questions the sell out startups … is it really the good life?
………………………………………□ Trade passion for meetings
……………○ 4/21/2008, 12:03 PM
……………○ This is not the movie industry
…………………………§ No need to dominate the box office
…………………………§ Solve small simple problems
…………………………§ Most of the great companies started small (200 companies)
…………………………§ Don’t Model after Facebook
……………○ VC Fuzz
…………………………§ Forget viral
…………………………§ Forget the overbaked ideas
…………………………§ Treat your customers nice and ask for $
……………○ Pressure to get started
…………………………§ People are selling stuff way before your idea
…………………………§ Sell it better
……………○ 4/21/2008, 12:06 PM
……………○ Basecamp
…………………………§ Developed w/ 3 people doing other stuff
…………………………§ Single server 1st year
…………………………§ Limited amount of time to work on something focuses your energy
…………………………§ He was contracting w/ 37 signals at this time … 10h/wk to develop basecamp
…………………………§ It makes the time really matter
…………………………§ Less time is a huge benefit
………………………………………□ BAUER COMMENT — Power comes from focus knowing value is each hour
…………………………§ Grew basecamp a year before you stopped doing consulting and just focused on basecamp
…………………………§ 7+ years for great businesses maybe longer
……………○ Don’t Overbuild
…………………………§ Deal with those issues later
……………○ Take it easy
…………………………§ There will never be less work
…………………………§ It will never be less
…………………………§ Amount of work in beginning creates more work
…………………………§ 14 hour days / 7 days a week … get out of that
…………………………§ Change the practices … or they will stick with you
……………○ 4/21/2008, 12:10 PM
……………○ Blame loss on someone else
……………○ 4/21/2008, 12:10 PM
……………○ Q&A
…………………………§ How does great achievement drive from small goals (i.e. how did Ruby on Rails happen)
………………………………………□ Solve simple problems. RoR was his effort to enjoy coding. Solve simple solution.
………………………………………□ Tons of VC come to them (RoR) .. .they say no … he uses RoR to build stuff … so he understands it …
………………………………………□ Solve simple problems that you are intimately involved with
…………………………§ What would you have done differently (BaseCamp, RoR)?
………………………………………□ Not much. Happy with results. Happy didn’t listen to give it away for free.
…………………………§ How many businesses are in the sweet spot of the fortune 5,000,000
………………………………………□ 500 to 1000 people … that is huge
………………………………………□ His focus
……………………………………………………® 3 people
……………………………………………………® 5 people
……………………………………………………® Guy doing something in his spare time
………………………………………□ Those people … want something that sounds like it works
…………………………§ The is no business too small for fortune 5,000,000
………………………………………□ Deal w/ people on monthly … you are not relying on 1 customer
………………………………………□ Big customers can yank your change
………………………………………□ Small customers but many you can control innovation
…………………………§ How stay focused
………………………………………□ How do you not get distracted … 10-14 hours a day
………………………………………□ Parent filter …
……………………………………………………® Joke
………………………………………□ Stop working in 14 hour a day … work 5 hours a day
………………………………………□ 37 signals is 4 day work weeks … 8 hrs a day … 2-3 hours productive
………………………………………□ Get 3 GREAT hours a day in

** END RAW SCRIBBLE TAKEN WHILE RUNNING **

April 21, 2008 Posted by bauertim | 1-Definitely Watch This | , , , , , | 6 Comments

Google App Engine - “Me Too” or “Game Changer”

On first blush Google App Engine (released to 10,000 developers yesterday) seems to be just another entry into scalable computing. But on further review there is quite a bit being introduced here that is notably different than the offerings of the early leaders of this space.

You can read the running thoughts at the bottom but here are my initial thoughts on what is unique on this offering when compared to other virtual computing plays.

Webcast Details Notable Points
Title/Link:

Duration:

  • 9m, 9m, 13m, 7m, 6m, 8m respectively

Speakers:

    Various

Recommend to Watch? Yes / No.

  • Part II (1st demo) was the best to see the power plus Part III to get a sense of the 5 part stack they are offering.
1. Nothings Free … But This Is Close

  • Basically, they are offering a free, hosted code driven website with a database (based on BigTable). The hidden cost is you have to write it in python right now. Hrmm … free … python … free … python. I don’t know python but I think I could learn python for this payback.

2. Ready to Sign? Too late. Sold Out. For now.

  • The 10,000 slots for the beta program are full as of this morning. But feel free to register to get notice when the open it up for pre-release (what ever happened to the word ‘beta’ … is that cliche now?).

3. No More Database. You Ruby On Rails people should dig that.

  • The Ruby on Rails posse has been big into defining tables via migrations so you can control the database version with the code version. Google takes it one step further. There is no database. Its just code classes interacting with Big Table. Is this the return of VSAM on steroids? Is the elegance of complex joins going out the window with this for something more old school (hello synch sort). Still, I think I like it.

4. Don’t Like Creating User Management Logic … Google Accounts

  • Looks like everyone is trying to get you to put your users in their user management model. If someone would say they support OpenID both ways I might listen.

5. Isn’t Virtual Server Images Better?

  • If AMZN is willing to provide (or working to provide) customers with on the fly allocated images of various server configurations they have or the customer creates isn’t that going to be more compelling? A setup where you can pick from a library of image configurations with all the stuff pre-loaded? When under load, spin up extra ’slices’ of that same image. Using all your stuff (not the limits of what google offers).

So at first blush, for rapid prototyping or throw away apps this looks pretty good. But for large scale computing in the cloud I think I will still look for setups where I can host my images (like IBM, AMZN, and MSFT seem to be pondering).

** START OF RAW SCRIBBLE TAKEN WHILE SITTING **

Campfire One: Introducing Google App Engine
4/8/2008, 5:40 AM
…………○ Intro - http://youtube.com/watch?v=3Ztr-HhWX1c
……………………§ Welcome Tom Stocke
…………Campfire One - Intro Google App
…………http://youtube.com/watch?v=3Ztr-HhWX1c
…………duration 9:10
…………
……………………2:20 - Google IO in May
……………………2:35 - kevin gibb (lead for Google App Engine)
……………………–Scalable infra is goal
……………………–Hard to create / deploy
……………………–Typical tasks - Apache server, Config, Tables, Scripts, Code push model, monitoring solutions
……………………–Find machines is 2nd task
……………………4:23
……………………–$
……………………–3rd challenge coming up
……………………–machines break, config issues,
……………………–app grows
……………………–design goals
……………………–1–Easy to use
……………………–2–Easy to scale
……………………–3–Free to get started
……………………–BAUER COMMENT (Free is good)
……………………–We run web apps (not a grid, not a virtual machine)
……………………–They run applications
……………………–Provide for entire lifecycle of web app (request log, application logs, push new version, run db, integrate tasks together)
……………………7:12
……………………–Easier to deploy
……………………–Access to google scaling model … google account, gfs (google file system), big table (?)
……………………–BAUER COMMENT (similar to AWS)
……………………–supports python only right now
……………………–SDK
……………………–Web based admin console
……………………–datastore (big table is thier model)
…………
…………○ Demo … 9m … http://youtube.com/watch?v=tcbpTQXNwac
……………………§ 4/8/2008, 5:43 AM
………………………………□ Uses a Yaml file
………………………………□ create project
………………………………□ looks like a config file (version, api_version, runtime
………………………………□ Handlers .. all code maps to main python file
……………………§ Switch to terminal
………………………………□ Starts web server locally
………………………………□ Works. Build webapp.
………………………………□ Starter app … web app …
………………………………□ Import from google
………………………………□ Define handler
…………………………………………® Get
…………………………………………® Hello msg
………………………………□ Run python with standard python wsgi
……………………§ Run
………………………………□ Stack track from python … line 18
………………………………□ Now fixed
……………………§ Add templates
………………………………□ Library based on jango templates
………………………………□ Import template
………………………………□ Use module to load template
……………………§ Build an app now
………………………………□ Form
……………………§ Put data in data store
………………………………□ Import datastore
………………………………□ Use concept of modelclass
………………………………□ Model class (table) by fields
………………………………□ On post request … create new shout (data) using form
……………………§ Write a query to pull data out
………………………………□ Gql (google query lang?) to pull out data
………………………………□ Create a dictionary to pass values into template
………………………………□ Use jango templates to render
……………………§ Clear data store
……………………§ Putting stuff in now
……………………§ Add sort order to query
……………………§ Extend data model and associated template
………………………………□ From who field added
……………………§ Example of handling data exceptions … formatting to code driven values
……………………§ Now push live to web
………………………………□ Another tool appconfig … deploy immediately
………………………………□ Cmd line
………………………………□ Pushes to live app
………………………………□ From local
………………………………□ Real time data create (tables etc)
……………………
…………○ Part III … Back to Kevin … 13m .. http://youtube.com/watch?v=oG6Ac7d-Nx8
……………………§ Back to 5 components
………………………………1. Scalable servering infra
…………………………………………a) Distributed / low overhead
…………………………………………b) Auto fault tolerant
…………………………………………c) Connect request to running instance in code is their work
…………………………………………d) Fluid in scaling … in response to demand
………………………………2. Python runtime
…………………………………………a) Language support is modular (api, console, etc - all generic so new lang later)
…………………………………………b) No restriction on code (js, css, html, etc)
………………………………3. SDK
…………………………………………a) Written in linux, mac, windows
…………………………………………b) Code, compile, test cycle … faster .. Local
………………………………4. Admin Console
…………………………………………a) Simpler LAMP stack
…………………………………………b) Add users, version running, tools on request logs / app logs, data explorer (vs sql admin), hook up domain, stats near real time, errors, what urls
………………………………5. Scalable Datastore
…………………………………………a) Schemaless object store
…………………………………………b) Supports million entities
…………………………………………c) Not on DBMS … uses BIG TABLE (google gear)
…………………………………………d) Horizontally distributed fault tolerant system
…………………………………………e) New tools, new way … no SQL … may like the system better in long run is their view …since there is no schema …new properties, new table … just code
…………………………………………f) Removes DBMS
…………………………………………g) Datastore model class
……………………………………………………i)
…………………………………………h) Advanced and primitative types supported
…………………………………………i) Data time property
…………………………………………j) Rating property
……………………………………………………i) Gdata Type (system from google) … symantic type … store entity and work w/ it in a generic way via an XML namespace
…………………………………………k) Query power
……………………………………………………i) Sort (single or multiple)
……………………………………………………ii) Transactions
……………………………………………………iii) Batch
……………………………………………………iv) User settable primary keys
…………………………………………l) Gql is like sql … jquery and fbql
……………………………………………………i) Googles sql on big table
……………………………………………………ii)
……………………………………………………iii) More complex
……………………………………………………iv)
……………………………………………………v) Joins not supported
………………………………………………………………One. Joins don’t work well across machines
…………………………………………………………………………First. BAUER COMMENT (linked server?)
………………………………………………………………Two. Allows to scale
…………………………………………………………………………First. BAUER COMMENT (who needs this level of scale? Worth the loss)
…………………………………………m) Email API
……………………………………………………i) No SMTP required … just create mail object and go
……………………………………………………ii) Outgoing HTTP requests
………………………………………………………………One. Use to integrate w/ webservices
…………………………………………n) Auth w/ Google Accounts
……………………………………………………i) Handle users alread
…………………………………………o) Support Frameworks
…………………………………………p) BAUER THOUGHT — Really the battle here is build 100% on our gear (w/ limits) and no latency risk … or split us/you … and get more control but less speed (network lag)
………………………………
…………○ Part IV - http://youtube.com/watch?v=oTFL7FPLnXY … 7m
……………………§ Gweedo (creator of python)
……………………§ Theme of ease for developers
……………………§ Now on google app engine team
……………………§ Reluctant user of power (root) … tries to not do … mess up … google app engine makes that go away
………………………………□ BAUER — IF its so easy why are releases / updates from google so slow on core lines?
……………………§ 4m in … still no notable comments
……………………§ 100% python lang
……………………§ Removed a few items from standard library
………………………………□ Don’t allow writes to file system
…………………………………………® Security, hard to track
………………………………□ No direct requests to web … open socket … use URL fetch … http or https via that … or mail send api
………………………………□ Threads
…………………………………………® Don’t need … distributed
……………………§ Add datastore, templates, jango (part of sdk, you can load your framework, etc)
……………………§ Lang unbiased … python is just first … looking for votes on 2nd lang
…………
…………○ Part V - Admin Console - Prod Mgr Pete Coomin .. 6m … http://youtube.com/watch?v=JcM2Ejk1tis
……………………§ Demo based on guestbook app
……………………§ Error / stack trace … admin sees error … users see 500 erro
……………………§ Use admin console … appengine.google.com
……………………§ Quota … governers … are in play
……………………§ CPU, data, emails, megabytes … mmonitored over 24 hour period
……………………§ Popular URI and error URI
……………………§ Log view on admin console … list of logs … filter by sev level / date-time
……………………§ Hits on broken URL
……………………§ Editing entities are possible
……………………§ Add developers for collab work
……………………§ Show rollback ability … between versions … code and db
……………………§ Serve any app engine app off any domain
……………………§ Add domain via google apps
…………
…………○ Part VI - Paul McDonald - Sample Apps - http://youtube.com/watch?v=K7usoKm5zwE … 8m
……………………§ Vorby
………………………………□ Movie quote site … vorby … search, browse, comment
………………………………□ Princess bride
…………………………………………® You tube video… etc
………………………………□ Search, filter,
………………………………□ 1:N relationships
……………………§ Barbound
………………………………□ List of top bars on front page
………………………………□ Google maps
………………………………□ Sign in via google account
………………………………□ Friends, comments,
………………………………□ Transactions in datastores
………………………………□ 1:N relationships
………………………………□ BAUER THOUGHT - THE RETURN TO VSAM?
……………………§ Huddlechat
………………………………□ Google has huddle room
………………………………□ Create new room or use existing
………………………………□ Chat app … pulls data store every few seconds
………………………………□ Transcripts
………………………………□ Upload files
……………………§ Port jiku … to google app engine
………………………………□ Recently joined google
………………………………□ Loads … see all jaiku application
………………………………□ His friends
………………………………□ Etc
………………………………□ Release when it is ready
……………………§ Same core components you have to use w/ your webapps
……………………§ Free to get started
………………………………□ 10,000 developers
………………………………□ 500MB storage
………………………………□ 200Mcpu cycles
………………………………□ 10GB bandwidth
………………………………□ 5 million pageviews a month
……………………§ Preview period
………………………………□ Large file up/down
………………………………□ Purchase additional capacity
………………………………□ Other lang
………………………………□ Offline processing
……………………§ Code.google.com
………………………………□ Video of presentation
………………………………□ Links to docs
………………………………□ Samples
………………………………□ Sdk
………………………………□ Links to signup

** END RAW SCRIBBLE TAKEN WHILE SITTING **

April 8, 2008 Posted by bauertim | 1-Definitely Watch This | , , , , | 7 Comments