Human Generated Data

Title

Untitled (crowd and TV crew looking on)
Date

1948
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.429.8

Human Generated Data

Title

Untitled (crowd and TV crew looking on)

People

Artist: Martin Schweig, American 20th century

Date

1948

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.429.8

Machine Generated Data

Tags

Amazon
created on 2019-03-25

Human 99.7
Person 99.7
Person 99.6
Person 99
Person 98.9
Person 98
Person 97.4
Person 96.9
Person 96.6
Person 96.5
Person 96.2
Person 96
Indoors 93.9
Room 93.9
Person 93.3
Person 92.6
Crowd 90.6
Person 90.4
Person 89.5
Person 88.9
Apparel 80
Clothing 80
People 79.2
Coat 74
Overcoat 74
Audience 71.4
Suit 69.7
Text 67.7
Person 67.1
Furniture 66.4
Face 66.2
Person 65.6
Person 61.4
Meal 60.8
Food 60.8
Reception 59.4
Classroom 57.6
School 57.6
Person 55.8
Person 47.6
Person 44.7

Clarifai
created on 2019-03-25

people 99.8
group 98.8
group together 98.3
many 96.4
man 94.9
adult 94.3
administration 92.9
crowd 92.5
music 91.8
woman 91.7
audience 87.9
wear 86
chair 86
musician 85.3
child 85.1
leader 84.1
actress 84
recreation 82.2
room 81.3
outfit 77

Imagga
created on 2019-03-25

people 35.7
person 34.3
man 31.6
male 29.8
teacher 27
adult 25.7
group 23.4
happy 21.3
together 20.1
couple 20
men 19.7
table 19.1
education 19
smiling 18.8
businessman 18.5
room 18.2
classroom 18
meeting 17.9
women 17.4
indoors 16.7
business 16.4
professional 16.2
school 15.8
student 15.7
home 15.1
team 14.3
smile 14.2
teamwork 13.9
lifestyle 13.7
educator 13.5
indoor 12.8
suit 12.6
child 12.5
family 12.4
office 12.3
friends 12.2
sitting 12
two 11.8
businesswoman 11.8
handsome 11.6
holding 11.5
interior 11.5
cheerful 11.4
boy 11.3
senior 11.2
love 11
portrait 11
happiness 11
girls 10.9
desk 10.5
fun 10.5
life 10.3
corporate 10.3
laptop 10
new 9.7
businesspeople 9.5
restaurant 9.5
planner 9.4
friendship 9.4
study 9.3
executive 9.3
alcohol 9.3
attractive 9.1
kid 8.9
chair 8.8
looking 8.8
conference 8.8
students 8.8
world 8.7
work 8.6
studying 8.6
shop 8.6
learning 8.4
drink 8.3
mother 8.3
confident 8.2
job 8
holiday 7.9
teaching 7.8
partner 7.7
class 7.7
modern 7.7
old 7.7
college 7.6
relationship 7.5
successful 7.3
children 7.3
aged 7.2
computer 7.2

Google
created on 2019-03-25

Photograph 97.1
Snapshot 88.4
Photography 67.8
Room 65.7
Stock photography 59.4
Black-and-white 56.4
History 54.1
Family 53.1
Vintage clothing 50.7

Microsoft
created on 2019-03-25

person 99.9
posing 93.3
group 86.6
people 80
crowd 0.9
black and white 0.3
school 0.3
child 0.2
boy 0.2
collection 0.2
retro 0.1

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 20-38
Gender Male, 52.4%
Calm 46.1%
Happy 45.4%
Confused 45.4%
Disgusted 45.1%
Sad 51.7%
Surprised 45.6%
Angry 45.7%

AWS Rekognition

Age 35-52
Gender Male, 54.8%
Happy 45.6%
Disgusted 45.1%
Calm 53.1%
Sad 45.7%
Surprised 45.2%
Confused 45.1%
Angry 45.1%

AWS Rekognition

Age 48-68
Gender Female, 54.4%
Happy 49.1%
Sad 49%
Surprised 45.4%
Disgusted 45.2%
Angry 45.5%
Calm 45.4%
Confused 45.4%

AWS Rekognition

Age 35-55
Gender Male, 53.9%
Confused 45.3%
Sad 50.9%
Angry 45.3%
Happy 45.2%
Calm 48%
Disgusted 45.2%
Surprised 45.2%

AWS Rekognition

Age 30-47
Gender Male, 54.5%
Calm 47.8%
Surprised 45.2%
Confused 45.6%
Sad 50.5%
Angry 45.5%
Happy 45.3%
Disgusted 45.1%

AWS Rekognition

Age 35-52
Gender Female, 82.9%
Sad 14.2%
Calm 68.6%
Happy 4.7%
Surprised 5.3%
Angry 1.9%
Disgusted 2.5%
Confused 2.7%

AWS Rekognition

Age 35-52
Gender Male, 54.9%
Surprised 45.2%
Sad 46.9%
Disgusted 45.1%
Happy 45.1%
Confused 45.3%
Calm 52%
Angry 45.4%

AWS Rekognition

Age 35-52
Gender Male, 54.2%
Happy 49.1%
Calm 47.6%
Confused 45.5%
Sad 45.9%
Disgusted 45.8%
Surprised 45.3%
Angry 45.7%

AWS Rekognition

Age 45-66
Gender Male, 54.6%
Sad 48.5%
Confused 45.6%
Disgusted 45.8%
Calm 46.1%
Happy 45.2%
Angry 48.6%
Surprised 45.2%

AWS Rekognition

Age 23-38
Gender Female, 52.3%
Confused 45.4%
Happy 45.9%
Surprised 45.4%
Disgusted 45.1%
Calm 48.9%
Angry 45.5%
Sad 48.7%

AWS Rekognition

Age 27-44
Gender Male, 54.3%
Sad 50.8%
Happy 46.2%
Confused 45.2%
Surprised 45.2%
Disgusted 45.1%
Calm 46.4%
Angry 46.1%

AWS Rekognition

Age 10-15
Gender Female, 51.7%
Surprised 45.3%
Angry 45.7%
Disgusted 45.3%
Calm 50%
Sad 48%
Confused 45.3%
Happy 45.4%

AWS Rekognition

Age 35-52
Gender Male, 54%
Happy 45.1%
Confused 45.1%
Sad 45.4%
Calm 54%
Surprised 45.1%
Angry 45.2%
Disgusted 45.1%

AWS Rekognition

Age 48-68
Gender Male, 51.6%
Happy 54.3%
Angry 45.1%
Sad 45.1%
Confused 45.1%
Disgusted 45%
Calm 45.1%
Surprised 45.2%

AWS Rekognition

Age 20-38
Gender Male, 97%
Happy 1.2%
Disgusted 0.3%
Calm 93.8%
Surprised 2.6%
Confused 1.2%
Angry 0.5%
Sad 0.4%

AWS Rekognition

Age 26-43
Gender Female, 54.6%
Confused 45.2%
Angry 45.3%
Surprised 45.5%
Sad 51.8%
Happy 45.2%
Calm 46.9%
Disgusted 45.1%

AWS Rekognition

Age 45-66
Gender Male, 54.7%
Confused 45.2%
Sad 46.8%
Calm 49.9%
Happy 45.3%
Surprised 45.2%
Angry 46.2%
Disgusted 46.4%

AWS Rekognition

Age 26-43
Gender Male, 51.8%
Sad 49.2%
Confused 45.7%
Angry 46.1%
Surprised 45.4%
Calm 46.5%
Happy 45.3%
Disgusted 46.7%

AWS Rekognition

Age 29-45
Gender Female, 54.9%
Calm 50.8%
Happy 45.7%
Confused 45.3%
Disgusted 45.2%
Sad 47.3%
Surprised 45.4%
Angry 45.3%

AWS Rekognition

Age 57-77
Gender Male, 50.2%
Calm 49.7%
Surprised 49.6%
Confused 49.6%
Sad 49.9%
Angry 49.6%
Happy 49.6%
Disgusted 49.6%

AWS Rekognition

Age 9-14
Gender Female, 50.3%
Surprised 49.6%
Calm 49.7%
Disgusted 49.6%
Happy 49.5%
Angry 49.6%
Sad 49.9%
Confused 49.6%

AWS Rekognition

Age 26-43
Gender Female, 54.8%
Surprised 45.7%
Sad 47%
Disgusted 46.1%
Happy 45.7%
Confused 45.9%
Calm 48.8%
Angry 45.8%

AWS Rekognition

Age 10-15
Gender Male, 50.1%
Confused 49.5%
Happy 49.5%
Surprised 49.5%
Disgusted 49.5%
Calm 50.1%
Angry 49.5%
Sad 49.8%

AWS Rekognition

Age 23-38
Gender Male, 51.1%
Happy 45.7%
Confused 45.6%
Disgusted 46%
Angry 46.2%
Calm 48.2%
Surprised 47.6%
Sad 45.7%

AWS Rekognition

Age 20-38
Gender Female, 50.4%
Happy 49.5%
Calm 50.4%
Sad 49.5%
Angry 49.5%
Confused 49.5%
Surprised 49.5%
Disgusted 49.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Suit
Person 99.7%
Person 99.6%
Person 99%
Person 98.9%
Person 98%
Person 97.4%
Person 96.9%
Person 96.6%
Person 96.5%
Person 96.2%
Person 96%
Person 93.3%
Person 92.6%
Person 90.4%
Person 89.5%
Person 88.9%
Person 67.1%
Person 65.6%
Person 61.4%
Person 55.8%
Person 47.6%
Person 44.7%
Suit 69.7%

Text analysis

Amazon

KSD
KSD-TV
MARTIN
MARTIN SCHWEIC
SCHWEIC
SAINT LOUIS
SAINT LOUIS SAINT
SAINT

Google

切 Ti KSD-TV MARTIN SCHWEIC SAINT LOUIS
切
Ti
KSD-TV
MARTIN
SCHWEIC
SAINT
LOUIS