architecture, cloud

Azure cli provides powerful tools before Portal is finally polished

But first , the tricky part is using Azure’s CLI tool . I would suggest using node version:

Installing : npm -g install azure-cli

Once you’re done, they require you to upload .publishsettings file , oddly named its also not easily accessible. Run the following command

azure account download

Above command will actually open a browser and if you’re logged in (azure) you will be able to download it.

Next step is importing it

azure account import filename.publishsettings

 

At this point you want to switch to Resource Manager mode, its a newer API architecture where everything is configurable via JSON structure and this is inline with new Portal management. The following command will switch you to that mode:

azure config mode arm

Few more handy resources when dealing with azure-cli

Using the Azure CLI for Mac, Linux, and Windows with Azure Service Management
coding

VisualStudio online doesnt use ssh, here is a tip

MS Visual Studio online was something new to me. It definitely is targeted for those using Visual Studio as product, however for those of us that us Atom or Sublime we’re a bit stuck.

VSS online doesn’t support ssh , so don’t bother looking for it.

What you’ll need to do is:

1. Setup alternate credentials (username and password ) This can be done in profile window

2. git clone http://<yourproject>.visualstudio.com/….

3.  git config credential.helper store

4. Make changes and push, it will prompt you for credentials but they will be saved and you won’t be prompted again

ps. keep in mind that credentials are saved in a file (hidden) and shouldn’t be exposed, hence the alternate credentials so that your MS account isnt exposed.

Voila

Uncategorized

Oracle Mysql Cluster 7.4 features

I’ve explored the features of Mysql Cluster 7.2 and 7.3 and now Oracle is coming out with 7.4 with very nice improvements.

This is yet another reason to go for baremetal (softlayer or others) and setup 4 node machine (or more) and enjoy the features of fairly priced or free mysql cluster.

These are the features listed from a Webinar :

 

  • Performance enhancements: MySQL Cluster 7.4 delivers a 50 percent performance improvement over MySQL Cluster 7.3 for Read-Only workloads and 40 percent improvement for Read/Write operations. Performance improvements are available through SQL or any of the native NoSQL APIs supported by MySQL Cluster. New records of 200 Million NoSQL Queries Per Second (QPS) and 2.5 Million SQL QPS were established.
  • New geographic redundancy features for high availability across data centers: The latest release provides rollback of any conflicting transactions – enabling full active-active, update-anywhere replication between geographically distant clusters, with applications able to send reads and writes to any site without compromising on consistency.
  • Faster online maintenance and recovery operationsincluding the ability to roll out software upgrades as much as 5x faster.
  • Enhanced distributed monitoring of memory usage and database operations.
bigdata

Creating Real Time topology in Apache Storm is amazing

Hiding away all the complexities of running nodes (hidden by zookeeper) and providing parallelism for Bolts (units of work in Storm) , as well as creating new Spouts (units of data steam, e.g. redis data, twitter stream or anything you want) allows you to focus on your real time product.

Once the bolt processes a string , adding a counter to it and pushing it to redis topic (using pub/sub).

On the other end, Web app is using d3 to grab all the content coming from a stream (simple python client connected to redis emits data)

 

That’s amazing.

 

 

architecture, bigdata, mongodb

MongoDB 3.0 worth the upgrade

MongoDB 3.0 (dev version of 2.8) has been almost a year in the making and there are several prominent changes that are worth mentioning:

 

  1. Document level locking – changes to those large json documents (aka rows ) will work similarly to regular RDBMS. Previously you had to either queue or create a custom way of handling inconsistencies.
  2. Document has a hard limit of 16megs (reasonable) and that allows your app to create massive amount of data that will require sharding your servers. A new storage engine WiredTiger will provide better compression for storage, allegedly up to 80% , shed those Gigs of data Foursquare!
  3. Besides other significant improvements, a new tool is introduced named Ops Manager, uncertain if it would be available to all or MMS subscribers.
  4. Looking into MongoDB Jira , there is a large set of bugs that have been fixed, better error handling in GEO lookups, syncing issues between nodes and others.

 

 

A few notes:

 

In order to take advantage of a new pluggable storage engine wiredTiger you need to explicitly configure it as such:

 

mongod --storageEngine wiredTiger

Overall great job!

 

 

coding, Uncategorized

GO lang is getting unofficial support from GCC compiler

Support for the Go programming language has been added to GCC. It is not enabled by default when you build GCC; use the –enable-languages configure option to build it. The driver program for compiling Go code is gccgo.

Go is currently known to work on GNU/Linux and RTEMS. Solaris support is in progress. It may or may not work on other platforms.

Reference: https://gcc.gnu.org/gcc-4.6/changes.html#go