Decision Tree

4 followers
0
Avatar
I tried the decision tree support in Datameer smart analytics. I can enter my data for training and the sheet shows me how the trained tree predicts on the training data. I found no way to use the trained decision tree to classify new data. So I can see, that my problem is well suited for decision trees. I also can see the used features and splits in the graph. I could translate that into a big nested if-if-if... formular and would make a lot of syntax errors. Is there any smarter solution that I have overlooked? If not, could you handle this as a change request, to offer classification of data by a trained decision tree.

 

Fritz Schinkel

4 comments

  • Avatar
    Fritz Schinkel

    Dear all,

    is there any news about using built-in decision trees in Datameer. The zementis plug-in can execute within Datameer models, which have been trained somewhere else. So in the case of decision trees the logical flow would be:

    1. Have data source intergarted with Datameer

    2. Prepare data as training data (add known results) and use Smart-Analytics, train a decision-tree, get decision rule and find out that the problem is well suited for decision trees.

    3. Export training data to another environment (e.g. R) and train again in this environment.

    4. Move learned decision rules via PMML and Zementis plugin back to Datameer.

    5. Execute zementis Plugin to classify data.

    Do I understamd this right? Then it is hard to argue the value of "Smart Analytics", since you need the same learning algorithm in another envirinment anyway.

    Kind regards

    Fritz

    0
    Comment actions Permalink
  • Avatar
    Joel Stewart

    Fritz I forwarded your comments to our Product Management team for further evaluation of being able to leverage a trained Decision Tree model from sample data across another data set. We'll share updates here as the Product Management team evaluates such an enhancement. 

    0
    Comment actions Permalink
  • Avatar
    Will Benica

    Hi Fritz,

    Your assessment of the difficulties of working with predictive analytics and Datameer is for the most part correct. Smart Analytics cannot integrate seamlessly into every workflow. There are many ways of addressing this, I feel this article could help describe more about how Datameer fits into a predictive modeling environment: https://datameer.zendesk.com/hc/en-us/articles/210188686.

    The true power of the Smart Analytics module is not to replace tools that have been specifically created for data scientists, e.g. R or MLlib. Smart Analytics allows business users to use machine leaning algorithms to work on exploratory analyses and help form follow-on analyses. The learning curve of Smart Analytics is much lower than for R or MLlib.

    You aren't the first person to suggest integrating Datameer more firmly into the predictive analytics environment, and I'm sure you won't be the last. But at the moment, our development team is concentrating on features that will make Datameer more powerful in general and easier to use.

    Cheers,

    Will

    0
    Comment actions Permalink
Please sign in to leave a comment.