AWS : Leader in Gartner's Quadrant 2020

AWS has been named as a Leader in the Magic Quadrant for Cloud Infrastructure and Platform Services - 2020. The AWS is placed highest in Ability to Execute and furthest in Completeness of Vision. As compared to Azure it has 4X market customers base.

Leaders Quadrant

    1) AWS (2006)

    2) Microsoft Azure (2010)

    3) Google (2011)

Challenger's Quadrant - No cloud provider

Nice Player Quadrant -

    1) Alibaba 

    2) Oracle

    3) IBM

    4) Tencent Cloud

Visionaries Quadrant- No cloud provider

 

 

AWS Vs Azure Vs Google Cloud: Market Shares and Growth Rate

In terms of cloud market, AWS has been the market leader since beginning. If you take a look at the following graph, it clearly depicts that:

• AWS is leading with around 30 percent of public cloud share and rest i
  
• Microsoft Azure is on the second place, owning around 16 percent of the worldwide market share.
• Google, on the third place, owns up to 10 percent of the market share worldwide.

 

 

 

• AWS has 5 years advantage over GCP & Azure.
• AWS is has better reach and available across more zones than GCP and Azure
• AWS has one-third of market shares in its name and is clear leader
• AWS has good growth rate but GCP is closing on with 100 percent growth
• Services offering of AWS, Azure, GCP :
  • When it comes to the number of services, the winner is AWS.
  • Regarding the integration with open-source and on-premise systems, such as MS tools, that are mostly used in almost all organizations, the winner is Azure.
• Pricing Models: Google Cloud has most economical pricing but Azure and AWS are quite close and AWS has more features and services as compared to GCP.
  

 

Data Preprocessing - Binning ( Data Science and stuff)

A simple, yet powerful concept used during data analysis that categorizes the data into different buckets/bins. One important point to remember is that “binning” and “clustering” are not the same and vary considerably in logic and implementation. Binning as a method of data pre-processing. Data binning (or bucketing) groups data in bins (or buckets), in the sense that it replaces values contained into a small interval with a single representative value for that interval. Sometimes binning improves accuracy in predictive models.

For example, if you have census data, you can bin “age” into [0 to 5], [5 to 9], [10 to 14] and so on.

Image of binning census data by age group -

Sometimes, binning can improve accuracy of the predictive models. In addition, sometimes we use data binning to group a set of numerical values into a smaller number of bins to have a better understanding of the data distribution. 

As example, “a automobile price” is an attribute range from 5,000 to 45,500.
Using binning, we categorize the price into three bins: low price, medium price, and high
prices. In the actual automobile dataset, ”price" is a numerical variable ranging from 5188 to 45400,
it has 201 unique values. We can categorize them into 3 bins: low, medium, and high-priced cars.
In Python we can easily implement the binning: We would like 3 bins of equal binwidth, so
we need 4 numbers as dividers that are equal distance apart.
1) First we use the numpy function “linspace” to return the array “bins” that contains
4 equally spaced numbers over the specified interval of the price.                                                       2)We create a list “group_names “ that contains the different bin names.
3) We use the pandas function ”cut” to segment and sort the data values into bins.
We can then use histograms to visualize the distribution of the data after they’ve been
divided into bins. This is sample histogram that we plotted based on the binning that we applied in the price feature. From the histogram plot, it is clear that most cars have a low price, and only very few cars have high price.

Another example of binning employee data by salary.

Steps to protect your business from #cyberattack

 

10 steps to protect your company from #CyberAttack

 

Customer Segmentation using Machine Learning

When you get tons of unlabeled data and you want to find some pattern in data to be used for some purpose like segmenting the data on basis of certain characteristics machine learning algorithm can be a big help. Lets take a example of tons of customer data of Target or Amazon or Flipcart. 

To use this data for building some value added service like recommendation engine or showing customer latest treds that he might be interested in or even showing ads that are most appropriate for customer based on his gender, age, location etc we need to first classify the customer into different segments. 

According to a Forrester report, only 33% of companies using customer segmentation find it significantly impactful. The main reason companies fail is that they are still using traditional customer segmentation approaches, without leveraging the breadth of customer data and advanced analytics techniques available today.

What is Customer Segmentation?

Customer Segmentation is one the most important applications of unsupervised learning. Using clustering techniques, companies can identify the several segments of customers allowing them to target the potential user base. In this machine learning project, we will make use of K-means clustering which is the essential algorithm for clustering unlabeled dataset. Before ahead in this project, learn what actually customer segmentation is.

What is Behavioral Segmentation?

Traditional approaches to segmentation focused mainly on who customers are and segments were based on demographic attributes such as gender or age, and firmographic attributes like company size or industry. But just understanding who your customers are is not enough anymore.  Behavioral segmentation is about understanding customers not just by who they are, but by what they do, using insights derived from customers’ actions.

Behavioral Segmentation is a form of customer segmentation that is based on patterns of behavior displayed by customers as they interact with a company/brand or make a purchasing decision. It allows businesses to divide customers into groups according to their knowledge of, attitude towards, use of, or response to a product, service or brand.

Why Segment Customers by Behavior?

Here are four main advantages of grouping customers into different segments based on their behaviors:

1. Higher Level Of Personalization. Understand how different groups of customers should be targeted with different offers, at the most appropriate times through their preferred channels, to effectively help them advance towards successful outcomes in their journeys.
2. Behaviourial  Predictivity. Use historical behavioral patterns to predict and influence future customer behaviors and outcomes.
3. Customer Prioritization. Make smarter decisions on how to best allocate time, budget and resources by identifying high-value customer segments and initiatives with the greatest potential business impact.
4. Evaluating Segment Performance. Monitor growth patterns and changes in key customer segments over time to gauge business health and track performance against goals. At a high level, this means quantifying the size and value of customer segments, and tracking how “positive” and “negative” segments are growing or shrinking over time.

Arogyasetu - The Health App with doubtful utility!

What is ArogyaSetu application?

ArogyaSetu is a COVID-19 contact tracing mobile application developed by the Ministry of Electronics and IT.  The application detects and tracks the mobile user’s movement with the help of GPS and Bluetooth sensors and sends out a notification if they come in contact with infected people by using its database and algorithms. Users have to enter personal information while registering on the app and the data will be shared only with the Government of India and does not include third parties as mentioned in the app’s privacy policy.

ArogyaSetu will be mandatory for Air travel

From 25th May Indian government is reopened its domestic air travel and made it mandatory for the traveler to have ArogyaSetu application installed on their mobile. So if the status of the ArogyaSetu App is Green and it shows message 'YOU ARE SAFE' then user will be allowed to travel and if the status is Red  and the application shows message the 'You are not safe'  then probably there will be some investigations and traveler may not be allowed to board the flight..

So why did I say ArogyaSetu application should be installed at least 15days before travel

• #ArogyaSetu Guidelines do not mention time frame for installation of the application. 
• As of today it is RECOMMENDED but NOT MANDTORY for every Indian to install the ArogyaSetu app. 
• As per new guidelines if you want to travel by flight then it is mandatory to install the ArogyaSetu app
• Those who do not use mobile phone will have to give a written declaration about their travel history 
• This means before traveling the user will be have to install the ArogyaSetuand but security will not know if the user installed app 1 month back or 15 minutes back as the app DOES NOT show that installation DATE on users MOBILE SCREEN. Possibly the data is available in the backend system
• So for a user who has installed the ArogyaSetufew 15 minutes back the status will always be Green
• The app is not smart enough to inform the security person that the user USER Status is Safe/Green because USER HAS INSTALLED APPLICATION 15 MINUTES BACK  and it is possible that user may be in contact of infected person before he installed the app.
• Bottom line is the ArogyaSetu application can be made more smart and intuitive to security & healthcare personal  

Lets understand the issue that I am highlighting with an example -

For example I have the ArogyaSetu application installed on my mobile but my mother is not comfortable with using mobile apps & she does not have ArogyaSetu installed on her phone. IN future if my mother has to travel by air then she will be told to install the ArogyaSetu App on her mobile or she will not be allowed to travel. Problem is there is no guideline on how many days prior to travel should one install ArogyaSetu application. 
        So my mother can install the app as late as just before reaching the airport and the ArogyaSetu app will show Green Status and message that' You are safe'. The dump app does not tell the security personnel that the user has installed the application just before entering the airport. If the Arogyasetu application did not track the users status for last 14 days (or more) and the Dumb App will still show STATUS as GREEN and there is no way to know that user has just installed the app, say 2 hours back or whatever the time period since installation of the ArogyaSetu application


The way ArogyaSetu works is it keeps a record of your movement and if you happen to come in close contact of a #corona patient then it flags you as a potential corona victim and shows your status as RED or UNSAFE Mind you ArogyaSetu showing RED does nto mean you are infected, it only means you were in close proximity of a infected person.But if you did not have ArogyaSetu app installed and then partied with a person who was #corona positive then #ArogyaSetu application is not smart enough to flag you RED. I am not saying ArogyaSetu application cannot be made smart, I am saying this ArogyaSetu app is not SMART.

So what should we do now  to protect Air Travelers from one infected person on the flight ?

Suggestion shared with ArogyaSetu team, Health Ministry Govt of India & Ministry of Civil Aviation are as follows -

1. A infected passenger traveling on plane is very dangerous so guidelines have to be improved
2. Modify the ArogyaSetu  application and on the main screen show the "Installation Date"
3. Unless the application was installed 14 days back the status of the user should be shown as 'Orange' or 'Needs Further Scrutiny'  because for 14 days since contacting a infected person the person can now show any symptoms of corona.
4. Make it mandatory for users to install application for certain services like Air Travel or travel in AC Train
5. ArogyaSetu team should inform the government the limitations of the application and dependency on installation date tracking and educate them on what INNOVATIVE THINGS can be added to the existing app.
6. Take suggestion and ideas from public on social-media platform. Our people should be free to give suggestions. 

Here are couple of slides to explain the above points

Update - 19 flyers on Air India’s Delhi-Wuhan flight test Covid positive on arrival at Wuhan Question is were these passengers not using ArogyaSetu? How did ArogyaSetu fail to identify the Covid positive patient that boarded flight to Wuhan, China ?



 

One Slide Plan To Transport MIgrant Workers To Their Home

Here is a one slider on transporting migrant workers from Host State (Example #Maharashtra) to Destination State (Example #Uttarpradesh ) or any other state.

Using Chef Tool for DevOps Automation

 

A Devops engineer spends more time in deploying new services and application, installing and updating network packages and making machine server ready for deployment. This takes tedious human efforts and requires huge human resources.By using configuration management tools like Chef or Puppet you can deploy, repair and update the entire application infrastructure using automation.

What is Chef?

Chef is a Configuration management tool that manages the infrastructure by writing code rather than using a manual process so that it can be automated, tested and deployed easily. Chef has Client-server architecture and it supports multiple platforms like Windows, Ubuntu and Solaris etc. It can also be integrated with cloud platform like AWS, Google Cloud, and Open Stack etc. 

Understanding Configuration Management

Let us take an example of a system engineer in an organization who wants to deploy or update software or an operating system on more than hundreds of systems in your organization in one day. This can be done manually but it may cause multiple errors, some software’s may crash while updating and we won’t be able to revert back to the previous version. To solve such kind of issues we use Configuration management tools.

Configuration Management keeps track of all the software and hardware related information of an organization and it also repairs, deploys and updates the entire application with its automated procedures. Configuration management does the work of multiple System Administrators and developers who manage hundreds of server and application. Some popular tools used for Configuration management are Chef, Puppet, Ansible, CF Engine, and SaltStack.

Why I prefer Chef Automation Tools?

Let us take a scenario, suppose we want our system administrator to install, update and deploy software on hundreds of system overnight. When the system engineer does this task manually it may cause Human errors and some software’s may not function properly. At this stage, we use Chef which is a powerful automated tool which transfers infrastructure into code.

Chef automates the application configuration, deployment and management throughout the network even if we are operating it on cloud or hybrid. We can use chef to speed up the application deployment. Chef is a tool for accelerating software delivery, the speed of software development refers to how quickly the software is able to change in response to new requirements or conditions

Benefits of Chef

Accelerating software delivery

 By automating infrastructure provisioning we automate all the software requirements like testing, creating new environments for software deployments etc. becomes faster.

Increased service Resiliency

By making the infrastructure automated we can monitors for bugs & errors before they occur it can also recover from errors more quickly.

Lower Risk Management

Automation tool like Chef or Puppet lowers risk and improves compliance at all stages of deployment. It reduces the conflicts during the development and production environment.

Easy Cloud Adoption  

Chef can be easily adapted to a cloud environment and the servers and infrastructure can be easily configured, installed and managed automatically by Chef.

Managing Data Centers & Cloud Env 

Chef can run on different platforms, under chef you can manage all your cloud and on-premise platforms including servers.

Streamlined IT operation & Workflow 

Chef provides a pipeline for continuous deployment starting from build to test and all the way through delivery, monitoring, and troubleshooting.

In summary Chef tools help IT teams adopt modern day best practices including:

• Test Driven Development: Configuration change testing becomes parallel to application change testing.
• DevOps Support: IT operations can confidently scale with data consolidations and 3rd party integrations.
• Self-Service: Agile delivery teams can provision and deploy infrastructure on-demand.

 

 

Why do agile & cloud work well together?

Agile & Cloud from an Organizational Perspective

Working solely on cloud projects for last 8+ years , I have seen that cloud and Agile go hand in hand. How is that?Well, cloud is something new and transformative for a lot of enterprise customers and, because it’s so new, these organizations lack the requirements or exact understanding of how they want to utilise the cloud. Naturally they struggle to articulate what they want and need, which as a problem lends itself nicely to the user story and demo methodologies in Agile.

Agile methodologies make it very easy for companies to articulate on a "high level" what they think they want users to be able to achieve with the cloud. They do this using the three pillars of Agile, which are transparency, inspection, and adaptation(http://www.scrumguides.org/scrum-guide.html for more details).

 

You can demo functionality and certain behaviors to your organization early, and learn to adapt to their needs and help them gain an understanding of what they really want to achieve with cloud technologies. This is also critical for organization as it makes the development transparent  and the demo acts as an inspection element for the company to workout if the product is exactly what they wanted. At Cloudreach this has allowed me to present back to large organization and assist them into getting to grips with how they would like to use the cloud, instead of a more traditional way of planning something which means spending months developing something that the business then might realize it doesn’t want.
 

Benefits to Agile planning  as twofold:

    It allows the organization (consultancy or internal IT arm) to be more responsive to demand
    It reduces the demand for change control (even more important from a consulting perspective) or delivering to a fixed scope, which would be highly administrative

 

Agile & Cloud from a Change Management Perspective

Cloud adoption isn’t just about a change of technology, it’s also a massive organizational change.  "The key to success in this new climate isn’t about technology, it’s about management vision. The organization — and its leaders — need a forward-thinking, entrepreneurial culture that capitalizes on this computing power. The mantra above is key to how the Agile mindset can really assist companies in avoiding their pre-existing controlling nature. Instead it can allow the more forward thinking entrepreneurial culture to develop. It’s this culture of entrepreneurship which is required to deliver impactful change via Cloud Adoption. A lot of goals the "C Level" aim for when they decide to adopt the cloud are the same as those the Agile mindset helps to achieve:

    Enabling Innovation
        Organizations moving away from control mindset
        Learning to fail fast and gain organizational learning which is critical for the advancement of technology
    Increased Efficiencies
        Smaller teams with more autonomy and less management
    Quicker Speed of Delivery
        Change in processes
        Iterative development
    Value Realization
        Delivering value earlier in the development chain

I could go on and on, but all of the above benefits are true with both cloud and Agile and, ultimately, in this context they clearly have strong symbiosis.

Agile & Cloud working Together

I have explained why Agile and the cloud work well together from both an organizational perspective and a change perspective and, lastly, I want to take you through a technical perspective. Cloud lends itself well to an Agile approach because of one major concept in the industry – "Infrastructure as Code" – which allows cloud infrastructure deployment to be done in a similar way to software delivery, a way that was impossible for traditional infrastructure.

Understanding Infrastructure as code

Definition: Infrastructure as Code (IaC) is the process of managing and provisioning computing infrastructure via code, rather than physical hardware configuration or the use of interactive configuration tools. This is around the automation of deployments of infrastructure which has been made possible with the growth of Cloud Computing. (

As Infrastructure is now being managed more and more via code like software has in the past, moving and adopting Agile Frameworks makes sense for cloud infrastructure delivery. This is why in the industry we see Agile becoming more and more preferred. The main blockers to this at the moment are organisational rather than technical.

So, as highlighted above, cloud and software development have many similarities. They both:

    Use Programming Languages (python, ruby, json, etc.)
    Use Code Management
    Follow Continuous Integration and Deployment (CI/CD)
    Require Testing (Regression, UAT, Integration)

However there are some differences:

    In the Cloud you are responsible for the environments and the underlying infrastructure of the code. E.g. Having to use code to create and manage your staging environment that other code sits on. This is not the case with software which depends on infrastructure being there.
    Infrastructure tends to be very logical and less tangible than software (i.e. you can’t see it) for example Firewall config just ports and IP address or Access Controls with error messages.

These differences can create challenges in my experience when following an Agile methodology:

    Demos pose a challenge due to the less tangible nature of cloud services, which I have solved in the past by trying to keep them focused on the user and business benefit
    I have also had to split user stories into environments first then use code management to assist with the big picture, this effectively creates a matrix of user stories adding some complexity, but also helps with clarity if done correctly
    Although 95% of cloud has API access and can be done via code some elements are manual which cannot be automated or follow software development practices

So, in conclusion, if I was an enterprise working on any cloud project, I really would recommend an Agile delivery method. It is going to help team’s align with the need for quicker delivery and higher quality of the inputs into the cloud. Additionally it helps organizations get greater value from their project and truly iterate towards the goal they are achieving so that they can recognize some of that value sooner.
 

Managing Covid Lockdown - Top-Down & Bottom-Up Strategy to revive industry & reboot economy

Dear #Indian Government,
Lockdown was essential measure to stop #coronavirus from spreading while we decided a strategy to combat it. But #Lockdown is not a solution & we can't #Lockdown the country for ever. If the farmers don't do farming & industry doesn't manufacture we will be out of essential commodities very soon and that will be even bigger problem than #corona.Govt should immediately publish the plan for  Incremental             UNLOCKDOWN as I call it so that States, Cities & Gram Panchayats can start preparing to implement the plan. As a executive I feel the lock-down announcement was unplanned, it forced each state to do a Unplanned Lockdown without creating a plan  (or defy Modi which no one wanted to do) & without any guidance from central government.
                         Our government is spending more money than ever to provide food & healthcare for needy people but #Revenue collection has become zero and soon government will be out of money. So unless we help STOP #CoronaVirus from spreading and unless industry starts working again and government gets its revenue #India will be in a big problem in few months.So I request all citizen of #India to please #StayHomeStaySafe , help our country to #Stop Corona from spreading , help #India to get our economy back in shape and that can only happen when industry/farmers/workers start working again.

In next few slides & text I am going to explain 4 key goals and then  explain my strategy to solve the problem

1. We need #Lockdown so people do not transmit virus & we stop corona virus from spreading
2. We have Limited Stock of grocery,medicine & consumables so we need farmers & industry to start working again   
3. We need a strategy to remove #Lockdown In Stages & need to start Removing #Lockdown
4. We cannot have One Plan for entire India -  We need 2 plans, one for the cities that are  infected by corona and 2nd for non-infected cities.
1. For Infected Cities we need a plan to Cure people & get Cities back to normal.
2. For Non-Infected Cities we need a plan to Protect City & Start industry & farming
3. We need to revive economy before it collapses further
4. We need to provide work & income particularly to the Poor who have no savings

Please note this is a high level plan to explain the  strategy and for implementation a more detailed plan has to be created to take care of all aspect of governance including points like

• How to cure people infected people? 
• How to prevent new infections ?
• How to identify non symptomatic carrier's of corona?
• How we will do more efficient testing with minimum kits ?
• How to protect out healthcare worker and police from infection 
• How to use Data to prevent new infection?
• How to use Data to identify 'who is getting killed by Corona' and 'who are all immune to Corona'? 
• How to use Data to find why infection is higher in some geography and less in others ?

and many more aspects which are kept out of this high level slides.

1)

2)

3)

4)

5)

6)

7)

8)

9)

10)

11)

12)

13)

Happy to answer any questions or correct any mistakes in my strategy. This is just one strategy, there could be other strategies but what is important is to have some strategy along with a risk mitigation plan and then discussion with stakeholders before we finalize a plan for India. My appeal to government of India is to work with a plan because so far they seem to b working on gut feeling and without any idea of what is planning. I hope better sense will prevail and there are thousands of voulenteers who are ready to leave their job and work for India if it can help save few lives. Jai Hind Jai Bharat.

World Health Organization recommended handrub formulations

How to prepare hand sanitizer as recommended by World Health Organization

Note : The official WHO website has detailed guidelines and this blog in only a reference to the WHO recommendations as of 23 March 2020. For latest updates please visit https://www.who.int/ and read the latest guidelines

To help countries and health-care facilities to achieve system change and adopt alcohol-based hand-rubs as the gold standard for hand hygiene in health care, WHO has identified formulations for their local preparation. Logistic, economic, safety, and cultural and religious factors have all been carefully considered by WHO before recommending such formulations for use worldwide. At present, alcohol-based hand-rubs are the only known means for rapidly and effectively inactivating a wide array of potentially harmful microorganisms on hands

WHO recommends alcohol-based handrubs based on the following factors:

1. evidence-based, intrinsic advantages of fast-acting and broad-spectrum microbicidal activity with a minimal risk of generating resistance to antimicrobial agents;
2. suitability for use in resource-limited or remote areas with lack of accessibility to sinks or other facilities for hand hygiene (including clean water, towels, etc.);
3. capacity to promote improved compliance with hand hygiene by making the process faster and more convenient;
4. economic benefit by reducing annual costs for hand hygiene, representing approximately 1% of extra-costs generated by HCAI
5. minimization of risks from adverse events because of increased safety associated with better acceptability and tolerance than other products 

Please read detailed instruction at who website link 
 https://www.who.int/gpsc/5may/Guide_to_Local_Production.pdf