CloudyML - Data Science & Analytics
46.6K subscribers
260 photos
54 videos
33 files
1.1K links
My Assignment Driven Data Science Courses
https://linktr.ee/cloudyml

My LinkedIn profile
https://www.linkedin.com/in/akashraj001

My Instagram
https://www.instagram.com/cloudyml.akash
Download Telegram
๐“๐จ๐๐š๐ฒ'๐ฌ ๐ข๐ง๐ญ๐ž๐ซ๐ฏ๐ข๐ž๐ฐ ๐๐ฎ๐ž๐ฌ๐ญ ๐ ๐€๐ง๐ฌ

๐‚๐จ๐ฆ๐ฉ๐š๐ง๐ฒ ๐๐š๐ฆ๐ž - ๐€๐œ๐œ๐ž๐ง๐ญ๐ฎ๐ซ๐ž
๐‘๐จ๐ฅ๐ž - ๐ƒ๐š๐ญ๐š ๐’๐œ๐ข๐ž๐ง๐ญ๐ข๐ฌ๐ญ

๐1. ๐…๐ž๐š๐ญ๐ฎ๐ซ๐ž ๐ฌ๐ž๐ฅ๐ž๐œ๐ญ๐ข๐จ๐ง ๐ฆ๐ž๐ญ๐ก๐จ๐๐ฌ ๐Ÿ๐จ๐ซ ๐ฌ๐ž๐ฅ๐ž๐œ๐ญ๐ข๐ง๐  ๐ญ๐ก๐ž ๐ซ๐ข๐ ๐ก๐ญ ๐ฏ๐š๐ซ๐ข๐š๐›๐ฅ๐ž๐ฌ ๐Ÿ๐จ๐ซ ๐›๐ฎ๐ข๐ฅ๐๐ข๐ง๐  ๐ž๐Ÿ๐Ÿ๐ข๐œ๐ข๐ž๐ง๐ญ ๐ฉ๐ซ๐ž๐๐ข๐œ๐ญ๐ข๐ฏ๐ž ๐ฆ๐จ๐๐ž๐ฅ๐ฌ?

Ans. Some of the Feature selection techniques are: Information Gain, Chi-square test, Correlation Coefficient, Mean Absolute Difference (MAD), Exhaustive selection, Forward selection, Regularization.


๐2. ๐“๐ซ๐ž๐š๐ญ ๐ฆ๐ข๐ฌ๐ฌ๐ข๐ง๐  ๐ฏ๐š๐ฅ๐ฎ๐ž๐ฌ?

Ans. They are:
1. List wise or case deletion
2. Pairwise deletion
3. Mean substitution
4. Regression imputation
5. Maximum likelihood.


๐3. ๐š๐ฌ๐ฌ๐ฎ๐ฆ๐ฉ๐ญ๐ข๐จ๐ง๐ฌ ๐ฎ๐ฌ๐ž๐ ๐ข๐ง ๐ฅ๐ข๐ง๐ž๐š๐ซ ๐ซ๐ž๐ ๐ซ๐ž๐ฌ๐ฌ๐ข๐จ๐ง? ๐–๐ก๐š๐ญ ๐ฐ๐จ๐ฎ๐ฅ๐ ๐ก๐š๐ฉ๐ฉ๐ž๐ง ๐ข๐Ÿ ๐ญ๐ก๐ž๐ฒ ๐š๐ซ๐ž ๐ฏ๐ข๐จ๐ฅ๐š๐ญ๐ž๐?

Ans. 1. Linear relationship.
2. Multivariate normality.
3. no or little multicollinearity.
4. no auto-correlation.
5. Homoscedasticity.

Data to be analyzed by linear regression were sampled violate one or more of the linear regression assumptions, the results of the analysis may be incorrect or misleading.


๐4. ๐‡๐จ๐ฐ ๐ข๐ฌ ๐ญ๐ก๐ž ๐ ๐ซ๐ข๐ ๐ฌ๐ž๐š๐ซ๐œ๐ก ๐ฉ๐š๐ซ๐š๐ฆ๐ž๐ญ๐ž๐ซ ๐๐ข๐Ÿ๐Ÿ๐ž๐ซ๐ž๐ง๐ญ ๐Ÿ๐ซ๐จ๐ฆ ๐ญ๐ก๐ž ๐ซ๐š๐ง๐๐จ๐ฆ ๐ฌ๐ž๐š๐ซ๐œ๐ก ๐ญ๐ฎ๐ง๐ข๐ง๐  ๐ฌ๐ญ๐ซ๐š๐ญ๐ž๐ ๐ฒ?

Ans. Random search differs from grid search in that we no longer provide an explicit set of possible values for each hyperparameter; rather, we provide a statistical distribution for each hyperparameter from which values are sampled. Essentially, we define a sampling distribution for each hyperparameter to carry out a randomized search.


๐5. ๐ˆ๐ฌ ๐ข๐ญ ๐ ๐จ๐จ๐ ๐ญ๐จ ๐๐จ ๐๐ข๐ฆ๐ž๐ง๐ฌ๐ข๐จ๐ง๐š๐ฅ๐ข๐ญ๐ฒ ๐ซ๐ž๐๐ฎ๐œ๐ญ๐ข๐จ๐ง ๐›๐ž๐Ÿ๐จ๐ซ๐ž ๐Ÿ๐ข๐ญ๐ญ๐ข๐ง๐  ๐š ๐’๐ฎ๐ฉ๐ฉ๐จ๐ซ๐ญ ๐•๐ž๐œ๐ญ๐จ๐ซ ๐Œ๐จ๐๐ž๐ฅ?
๐€ns. Support Vector Machine Learning Algorithm performs better in the reduced space. It is beneficial to perform dimensionality reduction before fitting an SVM if the number of features is large when compared to the number of observations.


๐6. ๐‘๐Ž๐‚ ๐‚๐ฎ๐ซ๐ฏ๐ž?
Ans ROC curve (receiver operating characteristic curve) is a graph showing the performance of a classification model at all classification thresholds. 

Happy learning with CloudyML๐Ÿ’™
How to handle 3 months notice period problem in company ?

Short Ans: https://go.cloudyml.com/notice-period-problem-1
Which of the following is not a valid aggregate function in SQL?
Anonymous Quiz
9%
COUNT
77%
COMPUTE
7%
SUM
7%
MAX
๐“๐จ๐๐š๐ฒ'๐ฌ ๐ˆ๐ง๐ญ๐ž๐ซ๐ฏ๐ข๐ž๐ฐ ๐๐ฎ๐ž๐ฌ๐ญ

๐‚๐จ๐ฆ๐ฉ๐š๐ง๐ฒ ๐๐š๐ฆ๐ž - ๐‚๐š๐ฉ๐ ๐ž๐ฆ๐ข๐ง๐ข
๐‘๐จ๐ฅ๐ž - ๐ƒ๐š๐ญ๐š ๐’๐œ๐ข๐ž๐ง๐ญ๐ข๐ฌ๐ญ

๐1. ๐ฉ-๐ฏ๐š๐ฅ๐ฎ๐ž?

๐€ns. p-value is a measure of the probability that an observed difference could have occurred just by random chance. The lower the p-value, the greater the statistical significance of the observed difference. P-value can be used as an alternative to or in addition to pre-selected confidence levels for hypothesis testing.


๐2. ๐ˆ๐ง๐ญ๐ž๐ซ๐ฉ๐จ๐ฅ๐š๐ญ๐ข๐จ๐ง ๐š๐ง๐ ๐„๐ฑ๐ญ๐ซ๐š๐ฉ๐จ๐ฅ๐š๐ญ๐ข๐จ๐ง?

๐€ns. Interpolation is the process of calculating the unknown value from known given values whereas extrapolation is the process of calculating unknown values beyond the given data points.



๐3. ๐”๐ง๐ข๐Ÿ๐จ๐ซ๐ฆ๐ž๐ ๐ƒ๐ข๐ฌ๐ญ๐ซ๐ข๐›๐ฎ๐ญ๐ข๐จ๐ง & ๐ง๐จ๐ซ๐ฆ๐š๐ฅ ๐๐ข๐ฌ๐ญ๐ซ๐ข๐›๐ฎ๐ญ๐ข๐จ๐ง?

๐€ns. The normal distribution is bell-shaped, which means value near the center of the distribution are more likely to occur as opposed to values on the tails of the distribution. The uniform distribution is rectangular-shaped, which means every value in the distribution is equally likely to occur.

๐4. ๐‘๐ž๐œ๐จ๐ฆ๐ฆ๐ž๐ง๐๐ž๐ซ ๐’๐ฒ๐ฌ๐ญ๐ž๐ฆ๐ฌ?

๐€ns. The recommender system mainly deals with the likes and dislikes of the users. Its major objective is to recommend an item to a user which has a high chance of liking or is in need of a particular user based on his previous purchases.  It is like having a personalized team who can understand our likes and dislikes and help us in making the decisions regarding a particular item without being biased by any means by making use of a large amount of data in the repositories which are generated day by day.

๐5. ๐‰๐Ž๐ˆ๐ ๐Ÿ๐ฎ๐ง๐œ๐ญ๐ข๐จ๐ง ๐ข๐ง ๐’๐๐‹

๐€ns. The SQL Joins clause is used to combine records from two or more tables in a database. 

๐6. ๐’๐ช๐ฎ๐š๐ซ๐ž๐ ๐ž๐ซ๐ซ๐จ๐ซ ๐š๐ง๐ ๐š๐›๐ฌ๐จ๐ฅ๐ฎ๐ญ๐ž ๐ž๐ซ๐ซ๐จ๐ซ?

๐€ns. mean squared error (MSE), and mean absolute error (MAE) are used to evaluate the regression problem's accuracy. The squared error is everywhere differentiable, while the absolute error is not (its derivative is undefined at 0). This makes the squared error more amenable to the techniques of mathematical optimization.

Happy learning with CloudyML๐Ÿ’™
โค1
How to handle 3 months notice period problem in company ?

Part 2 Ans: https://bit.ly/3-Months-Notice-Period
Which command is used to change the definition of a table in SQL? ๐Ÿง ๐Ÿ‘จโ€๐Ÿ’ป
Anonymous Quiz
10%
CREATE
34%
UPDATE
53%
ALTER
3%
SELECT
๐“๐จ๐๐š๐ฒ'๐ฌ ๐ˆ๐ง๐ญ๐ž๐ซ๐ฏ๐ข๐ž๐ฐ ๐๐ฎ๐ž๐ฌ๐ญ

๐‚๐จ๐ฆ๐ฉ๐š๐ง๐ฒ ๐๐š๐ฆ๐ž - ๐“๐ข๐ ๐ž๐ซ ๐€๐ง๐š๐ฅ๐ฒ๐ญ๐ข๐œ๐ฌ
๐‘๐จ๐ฅ๐ž - ๐ƒ๐š๐ญ๐š ๐’๐œ๐ข๐ž๐ง๐ญ๐ข๐ฌ๐ญ

๐1. ๐ƒ๐ž๐š๐ฅ ๐ฐ๐ข๐ญ๐ก ๐ฎ๐ง๐›๐š๐ฅ๐š๐ง๐œ๐ž๐ ๐›๐ข๐ง๐š๐ซ๐ฒ ๐œ๐ฅ๐š๐ฌ๐ฌ๐ข๐Ÿ๐ข๐œ๐š๐ญ๐ข๐จ๐ง?

๐€ns. Techniques to Handle unbalanced Data:
1. Use the right evaluation metrics 
2. Use K-fold Cross-Validation in the right way 
3. Ensemble different resampled datasets 
4. Resample with different ratios 
5. Design your own models


๐2. ๐€๐œ๐ญ๐ข๐ฏ๐š๐ญ๐ข๐จ๐ง ๐Ÿ๐ฎ๐ง๐œ๐ญ๐ข๐จ๐ง?

๐€ns. Activation functions are mathematical equations that determine the output of a neural network model. It is a non-linear transformation that we do over the input before sending it to the next layer of neurons or finalizing it as output. 



๐3. ๐ƒ๐ข๐ฆ๐ž๐ง๐ฌ๐ข๐จ๐ง ๐ซ๐ž๐๐ฎ๐œ๐ญ๐ข๐จ๐ง?

๐€ns. Dimensionality Reduction is used to reduce the feature space with consideration by a set of principal features.

๐4. ๐–๐ก๐ฒ ๐ข๐ฌ ๐ฆ๐ž๐š๐ง ๐ฌ๐ช๐ฎ๐š๐ซ๐ž ๐ž๐ซ๐ซ๐จ๐ซ ๐š ๐›๐š๐ ๐ฆ๐ž๐š๐ฌ๐ฎ๐ซ๐ž ๐จ๐Ÿ ๐ฆ๐จ๐๐ž๐ฅ ๐ฉ๐ž๐ซ๐Ÿ๐จ๐ซ๐ฆ๐š๐ง๐œ๐ž?

๐€ns. Mean Squared Error (MSE) gives a relatively high weight to large errors โ€” therefore, MSE tends to put too much emphasis on large deviations.


๐5. ๐‘๐ž๐ฆ๐จ๐ฏ๐ž ๐ฆ๐ฎ๐ฅ๐ญ๐ข๐œ๐จ๐ฅ๐ฅ๐ข๐ง๐ž๐š๐ซ๐ข๐ญ๐ฒ?

๐€ns. To remove multicollinearities, we can do two things. 
1. We can create new features 
2. remove them from our data.


๐6. ๐ฅ๐จ๐ง๐ -๐ญ๐š๐ข๐ฅ๐ž๐ ๐๐ข๐ฌ๐ญ๐ซ๐ข๐›๐ฎ๐ญ๐ข๐จ๐ง ?

๐€ns. A long tail distribution of numbers is a kind of distribution having many occurrences far from the "head" or central part of the distribution. Most of occurrences in this kind of distributions occurs at early frequencies/values of x-axis.


๐7. ๐Ž๐ฎ๐ญ๐ฅ๐ข๐ž๐ซ? ๐ƒ๐ž๐š๐ฅ ๐ฐ๐ข๐ญ๐ก ๐ข๐ญ?

๐€ns. An outlier is an object that deviates significantly from the rest of the objects. They can be caused by measurement or execution error. 
Removing outliers is legitimate only for specific reasons. Outliers can be very informative about the subject-area and data collection process. If the outlier does not change the results but does affect assumptions, you may drop the outlier. Or just trim the data set, but replace outliers with the nearest โ€œgoodโ€ data, as opposed to truncating them completely.


๐8. ๐„๐ฑ๐š๐ฆ๐ฉ๐ฅ๐ž ๐ฐ๐ก๐ž๐ซ๐ž ๐ญ๐ก๐ž ๐ฆ๐ž๐๐ข๐š๐ง ๐ข๐ฌ ๐š ๐›๐ž๐ญ๐ญ๐ž๐ซ ๐ฆ๐ž๐š๐ฌ๐ฎ๐ซ๐ž ๐ญ๐ก๐š๐ง ๐ญ๐ก๐ž ๐ฆ๐ž๐š๐ง ?

๐€ns. If your data contains outliers, then you would typically rather use the median because otherwise the value of the mean would be dominated by the outliers rather than the typical values. In conclusion, if you are considering the mean, check your data for outliers, if any then better choose median.


Happy learning with CloudyML๐Ÿ’™
Become A Job-Ready Data Scientist Just In 120 Hours

What are you getting in this course ?

1. 25+Guided Assignments for Hands-on Practical Learning
2. We have 10+ capstone projects to enhance your resume
3.We provide 1-1 Skype Course Support to resolve all the doubts between 3PM to 11:59PM, everyday including weekends
4. You will get 300+ data science interview questions and answers PDF collection
5. Course Completion Certificate
6. Additionally we provide job resources for reference like how to apply for jobs, resume samples, how to choose good ML projects, etc.

Who can join this course ?

Anybody from any background can learn from our course. No prior coding Experience required.

Anyone who wants to switch their career into data science can join our course.

It is a Self-Paced course with lifetime access

Trusted by 1800+ Learners, It is the best affordable Data Science course.

Original Price: Rs. 3499/-
Discounted Price for Today: Rs. 999/-

Visit Course : https://go.cloudyml.com/Learn-Data-Science-at-999

My LinkedIn Profile: https://www.linkedin.com/in/akashraj001/
If the depth of a Decision Tree is a large number then what becomes high?
Anonymous Quiz
51%
Bias
49%
Variance
Today's Interview Quest

Company Name - IBM
Role - Data Scientist

Q1. Assumptions required for carrying out linear regression?

Ans. The regression has five key assumptions:
Linear relationship.
Multivariate normality.
No or little multicollinearity.
No auto-correlation.
Homoscedasticity.


Q2. Pickling and Unpickling?

Ans. Pickling in python refers to the process of serializing objects into binary streams, while unpickling is the inverse of that. Itโ€™s called that because of the pickle module in Python which implements the methods to do this.


Q3. Lambda function?

Ans. Python Lambda Functions are anonymous function means that the function is without a name. As we already know that the def keyword is used to define a normal function in Python. Similarly, the lambda keyword is used to define an anonymous function in Python. This function can have any number of arguments but only one expression, which is evaluated and returned.


Q4. print(len(list1 + list2)). What is the output?

Ans. list1 + list2 gives a new list which is combined both of list1 and list2. so the length will be combined both length, i.e, len(list1) + len(list2).


Q5. Shallow copy and deep copy?

Ans. In Shallow copy, a copy of the original object is stored and only the reference address is finally copied. In Deep copy, the copy of the original object and the repetitive copies both are stored. Shallow copy is faster than Deep copy. The changes made in the copied object also reflect the original object in shallow copy. There is no reflection on the original object when the changes are made in the copied object in deep copy.


Q6. type I and type II error?

Ans. A type I error (false-positive) occurs if an investigator rejects a null hypothesis that is actually true in the population; a type II error (false-negative) occurs if the investigator fails to reject a null hypothesis that is actually false in the population.


Q7. Specificity?

Ans. Specificity (SP) is calculated as the number of correct negative predictions divided by the total number of negatives.


Q8. Combat overfitting and underfitting?

Ans. To avoid overfitting: Keep your model simple, Use regularization technique, Use cross-validation. To avoid underfitting: Decrease regularization, increase the training duration.

Happy Learning with CloudyML๐Ÿ’™
Today's Interview Quest

Name - TCS
Role - Data Scientist


Q1. Meaning when the p-values are high and low?

Ans. High P values: your data are likely with a true null. Low P values: your data are unlikely with a true null. A low P value suggests that your sample provides enough evidence that you can reject the null hypothesis for the entire population.



Q2. Missing values of more than 30%, how will you deal with such a dataset?

Ans. Simple approaches include taking the average of the column and use that value, or if there is a heavy skew the median or mode might be better. A better approach, you can perform regression or nearest neighbor imputation on the column to predict the missing values. Then continue on with your analysis/model.



Q3. random forest or multiple decision trees?

Ans. Random Forest is a classifier that contains a number of decision trees on various subsets of the given dataset and takes the average to improve the predictive accuracy of that dataset. It is based on model ensemble learning technique.


Q4. regularization method?

Ans. Regularization is a technique used for tuning the function by adding an additional penalty term in the error function. Regularization, significantly reduces the variance of the model, without substantial increase in its bias.


Q5. RMSE and MSE ?

Ans. MSE (Mean Squared Error) represents the difference between the original and predicted values which are extracted by squaring the average difference over the data set. It is a measure of how close a fitted line is to actual data points. The lesser the Mean Squared Error, the closer the fit is to the data set. The MSE has the units squared of whatever is plotted on the vertical axis. RMSE (Root Mean Squared Error) is the error rate by the square root of MSE. RMSE is the most easily interpreted statistic, as it has the same units as the quantity plotted on the vertical axis or Y-axis. RMSE can be directly interpreted in terms of measurement units, and hence it is a better measure of fit than a correlation coefficient.

Q6. Can time-series data be declared as stationery? How?

Ans. It is stationary when the variance and mean of the series are constant with time.


Q7. Pruning?

Ans. Pruning is a data compression technique in machine learning and search algorithms that reduces the size of decision trees by removing sections of the tree that are non-critical and redundant to classify instances.

Happy Learning with CloudyML๐Ÿ’™
Which of the following operator can be used with a multiple-row subquery? ๐Ÿค”๐Ÿง 
Anonymous Quiz
14%
=
46%
BETWEEN
16%
NOT IN
24%
<>
Today's Interview Quest

Company Name - Deloitte
Role - Data Scientist


Q1. Conditional Probability

Ans. Conditional probability formula gives the measure of the probability of an event given that another event has occurred.


Q2. Hypothesis Testing. Null and Alternate hypothesis

Ans. Hypothesis testing is defined as the process of choosing hypotheses for a particular probability distribution, on the basis of observed data Hypothesis testing is simply a core and important topic in statistics.
A null hypothesis is a statistical hypothesis in which there is no significant difference exist between the set of variables. It is the original or default statement, with no effect, often represented by H0 (H-zero). It is always the hypothesis that is tested.

Alternative Hypothesis is a statistical hypothesis used in hypothesis testing, which states that there is a significant difference between the set of variables. It is often referred to as the hypothesis other than the null hypothesis, often denoted by H1 (H-one). The acceptance of alternative hypothesis depends on the rejection of the null hypothesis i.e. until and unless null hypothesis is rejected, an alternative hypothesis cannot be accepted.



Q3. Why use Decision Trees?

Ans. First, a decision tree is a visual representation of a decision situation (and hence aids communication). Second, the branches of a tree explicitly show all those factors within the analysis that are considered relevant to the decision (and implicitly those that are not).


Q4. PCA Advantages and Disadvantages?
Ans.
Advantages: Removes correlated features, Improves algorithm features, Reduces overfitting, Improves Visualization.

Disadvantages: Independent variables become less interpretable, Data Standardization is must, Information loss.


Q5. Central Limit Theorem?

Ans. The central limit theorem states that if you have a population with mean ฮผ and standard deviation ฯƒ and take sufficiently large random samples from the population with replacement , then the distribution of the sample means will be approximately normally distributed.


Q6. Over Fitting and Under Fitting

Ans. Overfitting is a modeling error which occurs when a function is too closely fit to a limited set of data points. Underfitting refers to a model that can neither model the training data nor generalize to new data.


Q7. how to deal with imbalance data in classification modelling?

Ans. Follow these techniques:
1.Use the right evaluation metrics.
2. Use K-fold Cross-Validation in the right way.
3. Ensemble different resampled datasets.
4. resample with different ratios.
5. Cluster the abundant class.
6.Design your own models.

Happy Learning with CloudyML๐Ÿ’™
Have you heard of using Data Science for

โ€ข Fraud Prevention โ€ข Risk Management โ€ข Customer Analytics โ€ข Algorithmic Trading
Anonymous Poll
85%
Yes
15%
No
Know how Data Science is used in this four fields

Click here : https://bit.ly/Data-Science-in-Finance

Share this blog if you like it !
Today's Interview Quest

Company Name - Philips
Role - Data Scientist


Q1. Time Series (ARIMA)?

Ans. ARIMA, short for โ€˜AutoRegressive Integrated Moving Averageโ€™, is a forecasting algorithm based on the idea that the information in the past values of the time series can alone be used to predict the future values.


Q2. How to reduce overfitting. ?

Ans. Techniques to reduce overfitting:
*Increase training data.
*Reduce model complexity.
*Early stopping during the training phase.
*Ridge Regularization and Lasso Regularization.


Q3. What is precision/recall ratio?

Ans. When it comes to precision we're talking about the true positives over the true positives plus the false positives. As opposed to recall which is the number of true positives over the true positives and the false negatives.


Q4. Dimensionality reduction?

Ans. Dimensionality Reduction is used to reduce the feature space with consideration by a set of principal features.


Q5. Bias and variance?

Ans. Bias is one type of error which occurs due to wrong assumptions about data such as assuming data is linear when in reality, data follows a complex function. On the other hand, variance gets introduced with high sensitivity to variations in training data.


Q6. Difference between classification and clustering?

Ans. In classification data are grouped by analyzing data objects whose class label is known. Clustering analyzes data objects without knowing class label. There is some prior knowledge of attributes of each classification. There is no prior knowledge of attributes of data to form clusters.


Q7. Deal unbalanced classification?

Ans. Techniques to Handle Imbalanced Data
*Use the right evaluation metrics
*Use K-fold Cross-Validation in the right way
*Ensemble different resampled datasets
*Resample with different ratios
*Cluster the abundant class
*Design your own model

Happy learning with CloudyML๐Ÿ’™