Human Generated Data

Title

Untitled (guests standing near TV camera)

Date

1948

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.429.14

Human Generated Data

Title

Untitled (guests standing near TV camera)

People

Artist: Martin Schweig, American 20th century

Date

1948

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.429.14

Machine Generated Data

Tags

Amazon
created on 2019-03-25

Human 98.8
Person 98.8
Person 98.4
Person 98.1
Accessories 97.5
Tie 97.5
Accessory 97.5
Coat 96.9
Clothing 96.9
Overcoat 96.9
Apparel 96.9
Person 95
Person 94.3
Person 91.2
Tuxedo 89.7
Suit 82.4
People 81.5
Face 72
Suit 68.7
Military Uniform 67.3
Officer 67.3
Military 67.3
Tripod 64.8
Crowd 63

Clarifai
created on 2019-03-25

people 100
group 99.6
group together 99.4
administration 99.1
leader 98.8
several 98.1
adult 97.8
man 95.3
five 94.6
four 94.6
many 94.4
war 93.3
military 92.2
three 90.2
outfit 90
wear 89.2
chair 88.9
woman 88.2
offense 86
vehicle 76.9

Imagga
created on 2019-03-25

man 39.6
couple 32.2
people 30.7
male 29.8
adult 26.8
person 26
military uniform 23.3
uniform 22.6
clothing 22.2
happy 21.9
portrait 20.1
love 18.9
business 18.2
together 17.5
standing 17.4
family 16
smiling 15.9
happiness 15.7
attractive 14.7
lifestyle 14.5
two 14.4
home 14.4
suit 14.2
men 13.7
professional 13.2
groom 12.9
office 12.9
fashion 12.8
married 12.5
face 12.1
nurse 11.9
old 11.8
dress 11.7
indoors 11.4
smile 11.4
senior 11.2
women 11.1
work 11
romantic 10.7
husband 10.7
bride 10.5
room 10.4
sitting 10.3
wedding 10.1
holding 9.9
black 9.8
cheerful 9.8
human 9.7
covering 9.7
consumer goods 9.7
businessman 9.7
looking 9.6
elderly 9.6
tie 9.5
adults 9.5
life 9.3
casual 9.3
one 9
handsome 8.9
job 8.8
sexy 8.8
hugging 8.8
formal 8.6
wife 8.5
mature 8.4
businesswoman 8.2
group 8.1
success 8
interior 8
boy 7.8
child 7.8
marriage 7.6
doctor 7.5
relationship 7.5
fun 7.5
outdoors 7.5
style 7.4
retro 7.4
inside 7.4
joyful 7.3
lady 7.3
aged 7.2
patient 7.1
mother 7.1
medical 7.1

Google
created on 2019-03-25

Microsoft
created on 2019-03-25

person 100
standing 96.4
group 93.7
posing 92.8
people 89.6
old 47.3
military 7.7
black and white 7.4
navy 3.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 60-80
Gender Male, 99%
Happy 41.3%
Surprised 8.5%
Sad 3.8%
Confused 23.3%
Angry 6.4%
Disgusted 6.3%
Calm 10.3%

AWS Rekognition

Age 15-25
Gender Female, 92.1%
Happy 3.1%
Confused 10.7%
Sad 43.6%
Calm 21.1%
Surprised 8.6%
Angry 11%
Disgusted 2%

AWS Rekognition

Age 23-38
Gender Female, 99%
Happy 73.4%
Calm 2.6%
Sad 6.6%
Angry 5.1%
Confused 6%
Surprised 3.4%
Disgusted 3%

AWS Rekognition

Age 26-43
Gender Female, 95.2%
Happy 87.8%
Confused 2.1%
Disgusted 1.5%
Angry 1.9%
Calm 0.7%
Surprised 4.7%
Sad 1.4%

AWS Rekognition

Age 26-43
Gender Male, 97.1%
Confused 1.3%
Angry 2.7%
Surprised 1.3%
Sad 7%
Happy 0.4%
Calm 87.1%
Disgusted 0.3%

AWS Rekognition

Age 35-52
Gender Male, 83.1%
Happy 2.7%
Confused 4.7%
Disgusted 2%
Angry 4.2%
Calm 79.2%
Surprised 2.9%
Sad 4.3%

AWS Rekognition

Age 20-38
Gender Female, 98.1%
Happy 6.6%
Calm 32.7%
Sad 21%
Angry 19.7%
Confused 7.4%
Surprised 7.2%
Disgusted 5.4%

Microsoft Cognitive Services

Age 62
Gender Male

Microsoft Cognitive Services

Age 30
Gender Female

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 36
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%
Tie 97.5%
Suit 82.4%

Categories

Imagga

people portraits 87.6%
paintings art 9.8%

Text analysis

Amazon

MARTIN
MARTIN SCHWEIC
SCHWEIC
SAINT LOUIS

Google

MARTIN SCHWEIC SAINT LOU
MARTIN
SCHWEIC
SAINT
LOU