Human Generated Data

Title

Untitled (twelve young family members posed sitting in living room)
Date

1949
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9231

Human Generated Data

Title

Untitled (twelve young family members posed sitting in living room)

People

Artist: Martin Schweig, American 20th century

Date

1949

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9231

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 99.6
Person 99.6
Person 99.1
Person 98.7
Person 98.6
Person 97.5
Person 97.5
Person 97.4
Clothing 96.4
Apparel 96.4
Chair 95.3
Furniture 95.3
Person 95.2
Face 93.3
Person 88.9
Person 83.6
Female 82.7
Indoors 82.3
Play 80
Room 78.8
Kid 78.4
Child 78.4
People 76
Helmet 74.7
Portrait 74.7
Photography 74.7
Photo 74.7
Floor 74.5
Baby 71.9
Plant 69.5
Girl 69.5
Flooring 69.4
Coat 67.2
Suit 67.2
Overcoat 67.2
Door 65.5
Text 65.4
Shorts 61.7
Dress 61.6
Living Room 60.6
Housing 59.2
Building 59.2
Table 58.4
Smile 58.3
Couch 57.1
Woman 55.6
Costume 55.1
Person 41.7

Clarifai
created on 2023-10-27

people 99.8
group 99.5
child 99.1
group together 98.6
adult 95.9
education 95.8
woman 95.2
many 93.8
man 92.3
school 91.1
boy 91
adolescent 89.5
several 89.2
wear 87.2
recreation 86.7
monochrome 84
leader 83
portrait 82.7
son 80.9
teacher 80.7

Imagga
created on 2022-01-23

man 34.9
kin 33.2
male 31.2
person 30.2
people 29
classroom 22.4
room 22.3
group 21.7
men 20.6
businessman 20.3
smiling 20.2
business 20
happy 19.4
adult 18.8
team 17.9
couple 17.4
senior 16.9
home 15.9
indoors 14.9
nurse 14.2
office 13.6
portrait 13.6
professional 13.5
meeting 13.2
teamwork 13
family 12.4
together 12.3
boy 12.2
mature 12.1
sitting 12
gymnasium 11.8
player 11.6
30s 11.5
businesswoman 10.9
lifestyle 10.8
teacher 10.7
talking 10.4
standing 10.4
desk 10.4
planner 10.2
cheerful 9.7
sport 9.7
mid adult 9.6
four 9.6
student 9.5
women 9.5
businesspeople 9.5
athletic facility 9.4
world 9.4
child 9.3
inside 9.2
silhouette 9.1
to 8.8
medical 8.8
discussion 8.8
school 8.8
colleagues 8.7
education 8.7
smile 8.5
facility 8.5
enjoying 8.5
friends 8.4
black 8.4
camera 8.3
executive 8.3
indoor 8.2
worker 8
job 8
explaining 7.9
contestant 7.9
day 7.8
happiness 7.8
corporate 7.7
youth 7.7
elderly 7.7
golfer 7.6
casual 7.6
two 7.6
communication 7.6
horizontal 7.5
doctor 7.5
friendship 7.5
mug shot 7.3
success 7.2
working 7.1
patient 7
modern 7

Google
created on 2022-01-23

Style 83.9
Font 77.1
Monochrome 74.4
Monochrome photography 72.8
Musical instrument 70.9
Crew 69.1
Vintage clothing 68.3
Event 66.9
Suit 66.7
Room 66.3
Team 63.8
Window 63.4
Photo caption 63.4
Stock photography 62.9
Chair 59.3
Illustration 58
Guitar 57.9
Sitting 56.5
History 55.4
Ball 53.2

Microsoft
created on 2022-01-23

person 99.6
clothing 96
text 89.8
outdoor 89
man 87.3
posing 62.9

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 18-26
Gender Male, 99.9%
Calm 61.6%
Surprised 14.3%
Happy 11.7%
Sad 9.9%
Angry 1%
Disgusted 0.7%
Confused 0.4%
Fear 0.4%

AWS Rekognition

Age 23-31
Gender Male, 59.7%
Calm 96.9%
Sad 1.9%
Happy 0.4%
Disgusted 0.3%
Fear 0.2%
Confused 0.2%
Angry 0.1%
Surprised 0.1%

AWS Rekognition

Age 18-26
Gender Female, 81.3%
Happy 64.1%
Calm 24.5%
Surprised 4.8%
Angry 2%
Sad 1.7%
Fear 1.3%
Disgusted 1%
Confused 0.6%

AWS Rekognition

Age 25-35
Gender Male, 95.7%
Calm 71.7%
Happy 10.6%
Angry 8.4%
Surprised 3.8%
Disgusted 2.3%
Sad 1.6%
Fear 1.2%
Confused 0.4%

AWS Rekognition

Age 27-37
Gender Male, 98.8%
Calm 89.2%
Sad 6.3%
Angry 1.5%
Surprised 0.7%
Confused 0.7%
Disgusted 0.6%
Fear 0.6%
Happy 0.2%

AWS Rekognition

Age 23-33
Gender Female, 64.1%
Surprised 93%
Calm 4.7%
Happy 0.7%
Angry 0.5%
Fear 0.4%
Disgusted 0.4%
Sad 0.1%
Confused 0.1%

AWS Rekognition

Age 14-22
Gender Female, 57.8%
Calm 84.5%
Surprised 13.3%
Sad 1.1%
Disgusted 0.3%
Confused 0.2%
Angry 0.2%
Fear 0.2%
Happy 0.1%

AWS Rekognition

Age 18-26
Gender Male, 80.9%
Calm 70%
Happy 10%
Surprised 6.7%
Angry 4%
Fear 3.3%
Disgusted 2.7%
Sad 2.1%
Confused 1.3%

AWS Rekognition

Age 18-24
Gender Male, 100%
Calm 83.6%
Angry 6.6%
Sad 3.9%
Surprised 1.6%
Confused 1.6%
Disgusted 1.6%
Happy 0.8%
Fear 0.4%

AWS Rekognition

Age 25-35
Gender Male, 99%
Calm 81.4%
Angry 5.1%
Surprised 4.8%
Happy 4.5%
Sad 1.5%
Fear 1.1%
Disgusted 1%
Confused 0.6%

AWS Rekognition

Age 14-22
Gender Male, 79.8%
Sad 93.8%
Calm 5.3%
Angry 0.3%
Fear 0.2%
Confused 0.2%
Disgusted 0.1%
Happy 0.1%
Surprised 0.1%

AWS Rekognition

Age 23-33
Gender Female, 62.4%
Surprised 76.1%
Calm 17.5%
Fear 1.9%
Angry 1.3%
Disgusted 1.3%
Happy 1.2%
Sad 0.4%
Confused 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Helmet 74.7%

Categories

Imagga

people portraits 95%
events parties 3.2%

Text analysis

Amazon

3
8
<F 3 8 a 8
a 8
<F

Google

3 8 a }
8
a
3
}