Human Generated Data

Title

Industrial Problems, Welfare Work: United States. Pennsylvania. Pittsburgh. H.J. Heinz Company: A Cooking Class.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.365

Human Generated Data

Title

Industrial Problems, Welfare Work: United States. Pennsylvania. Pittsburgh. H.J. Heinz Company: A Cooking Class.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.365

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Person 99.2
Human 99.2
Person 97.2
Person 95.5
Person 95.2
Furniture 93.6
Chair 90.9
Apparel 90.4
Clothing 90.4
Person 90.3
Person 89.8
Face 85.1
Room 79.7
Indoors 79.7
People 79.6
Bed 74.8
Table 71.5
Bedroom 70.8
Person 70.5
Female 67.8
Plant 66.6
Child 63.9
Kid 63.9
Photo 63.4
Photography 63.4
Person 62.9
Girl 62
Person 60.9
Portrait 60.1
Meal 58.9
Food 58.9
Classroom 55.2
School 55.2
Person 45.2
Person 41.9

Clarifai
created on 2019-06-05

people 99.9
adult 98.3
group 97.4
many 94.3
woman 93.8
group together 93.1
man 91.4
indoors 90.5
leader 90.5
administration 89.2
portrait 89.1
uniform 86.8
several 86.4
wear 86.3
room 84.1
education 82.1
furniture 82.1
child 81.9
outfit 81.8
sit 78.6

Imagga
created on 2019-06-05

man 32.4
person 31.6
people 29
room 28.9
classroom 27.6
adult 26.6
male 23.4
teacher 23.2
nurse 23
happy 22.5
couple 21.8
professional 19.5
businessman 18.5
business 18.2
portrait 18.1
smiling 18.1
family 16.9
group 16.1
child 16
home 15.9
kin 14.9
men 14.6
student 14.4
happiness 14.1
dress 13.5
together 13.1
office 12.9
smile 12.8
work 12.5
bride 12.5
educator 11.9
blackboard 11.9
education 11.2
world 10.6
success 10.5
boy 10.4
senior 10.3
wedding 10.1
businesswoman 10
mother 10
groom 9.9
team 9.8
cheerful 9.7
love 9.5
bouquet 9.4
indoor 9.1
holding 9.1
old 9.1
fun 9
life 8.9
looking 8.8
indoors 8.8
lifestyle 8.7
corporate 8.6
face 8.5
school 8.5
casual 8.5
two 8.5
friends 8.4
attractive 8.4
joy 8.3
teamwork 8.3
20s 8.2
new 8.1
worker 8.1
celebration 8
husband 8
women 7.9
father 7.8
married 7.7
hand 7.6
meeting 7.5
girls 7.3
color 7.2
holiday 7.2
handsome 7.1
to 7.1
job 7.1
working 7.1

Google
created on 2019-06-05

Microsoft
created on 2019-06-05

wall 97.7
posing 93.4
person 90.9
clothing 90.7
indoor 88.1
old 84
smile 82.9
human face 70.9
woman 68.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 15-25
Gender Female, 54.7%
Calm 46.8%
Disgusted 45.2%
Happy 45.3%
Confused 45.3%
Surprised 45.1%
Sad 51.3%
Angry 46%

AWS Rekognition

Age 17-27
Gender Female, 53.7%
Angry 51.8%
Sad 47.5%
Disgusted 45.5%
Calm 45.1%
Surprised 45%
Confused 45.1%
Happy 45%

AWS Rekognition

Age 26-43
Gender Male, 53.3%
Disgusted 45.1%
Surprised 45.1%
Sad 47.2%
Angry 50.3%
Happy 45.1%
Confused 45.2%
Calm 47%

AWS Rekognition

Age 35-52
Gender Male, 51.2%
Angry 45.3%
Happy 45.9%
Disgusted 45.1%
Confused 45.3%
Calm 51.4%
Surprised 45.2%
Sad 46.9%

AWS Rekognition

Age 35-52
Gender Female, 53.9%
Calm 45.7%
Angry 48.3%
Happy 45.2%
Sad 48.8%
Surprised 45.2%
Confused 45.2%
Disgusted 46.8%

AWS Rekognition

Age 20-38
Gender Female, 51%
Confused 45.2%
Sad 45.9%
Disgusted 45.1%
Angry 45.2%
Happy 45.1%
Calm 53.3%
Surprised 45.1%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Calm 45.8%
Surprised 45.1%
Happy 45.1%
Angry 45.7%
Confused 45.1%
Sad 53.2%
Disgusted 45.1%

AWS Rekognition

Age 35-52
Gender Female, 50.9%
Confused 45.3%
Happy 45.1%
Surprised 45.1%
Calm 52.6%
Angry 45.7%
Sad 46.1%
Disgusted 45.2%

AWS Rekognition

Age 27-44
Gender Male, 54.1%
Angry 47.3%
Surprised 45.1%
Disgusted 45%
Sad 47.4%
Happy 45%
Confused 45.1%
Calm 50%

AWS Rekognition

Age 26-43
Gender Male, 50.9%
Disgusted 45%
Confused 45%
Surprised 45%
Calm 45.1%
Happy 45%
Angry 54.8%
Sad 45.1%

AWS Rekognition

Age 14-25
Gender Male, 51.2%
Angry 45.6%
Surprised 45.2%
Sad 52.8%
Confused 45.2%
Calm 45.9%
Disgusted 45.1%
Happy 45.1%

AWS Rekognition

Age 20-38
Gender Female, 54.4%
Disgusted 45.2%
Confused 45.6%
Happy 45.2%
Calm 50.9%
Surprised 45.4%
Sad 45.9%
Angry 46.8%

AWS Rekognition

Age 35-52
Gender Male, 53.7%
Angry 45.2%
Sad 45.3%
Disgusted 45.1%
Happy 45.1%
Confused 45.1%
Calm 54.3%
Surprised 45.1%

Microsoft Cognitive Services

Age 21
Gender Female

Microsoft Cognitive Services

Age 36
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%

Categories

Text analysis

Amazon

COOKING
A
A COOKING CLASS
CLASS

Google

A COOKING CLASS
A
COOKING
CLASS