Human Generated Data

Title

Untitled (group portrait of nine member family in living room with grandfather clock)

Date

1936

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9104

Human Generated Data

Title

Untitled (group portrait of nine member family in living room with grandfather clock)

People

Artist: Martin Schweig, American 20th century

Date

1936

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.2
Human 99.2
Person 99
Person 98.9
Person 98.9
Person 98.8
Apparel 98.7
Clothing 98.7
Person 98
Person 98
Person 94.4
Person 91.6
Face 79.7
Stage 77.1
People 76.4
Leisure Activities 69.9
Dance Pose 69.9
Female 68.5
Sleeve 67
Photo 66.7
Portrait 66.7
Photography 66.7
Dress 60.9
Art 58.9
Coat 58.7
Flooring 58.7
Long Sleeve 57
Screen 56.7
Electronics 56.7
Person 56.7
Person 46.5
Person 45

Imagga
created on 2022-01-23

nurse 52.5
person 41.8
television 36.6
people 34.6
man 32.9
male 28.4
adult 24.8
professional 20.3
happy 19.4
smiling 18.8
room 18.6
couple 18.3
men 18
teacher 17.5
businessman 16.8
patient 16.3
office 16.1
home 15.9
women 15.8
indoors 15.8
telecommunication system 15.4
desk 15.1
business 14.6
happiness 14.1
broadcasting 13.5
group 12.9
love 12.6
modern 12.6
sport 12.4
portrait 12.3
computer 12.2
cheerful 12.2
sitting 12
training 12
indoor 11.9
two 11.9
silhouette 11.6
lifestyle 11.6
skill 11.6
smile 11.4
event 11.1
player 11.1
athlete 10.9
bright 10.7
groom 10.6
match 10.6
crowd 10.6
together 10.5
educator 10.4
looking 10.4
education 10.4
life 10.3
work 10.2
lights 10.2
competition 10.1
field 10
telecommunication 10
hand 9.9
versus 9.9
team 9.8
cheering 9.8
nighttime 9.8
audience 9.7
job 9.7
stadium 9.7
championship 9.7
interior 9.7
patriotic 9.6
muscular 9.5
nation 9.5
togetherness 9.4
symbol 9.4
casual 9.3
mature 9.3
laptop 9.2
glowing 9.2
coat 9.2
monitor 9.2
flag 9.2
attractive 9.1
park 9.1
blackboard 9
black 9
suit 9
handsome 8.9
working 8.8
medical 8.8
shorts 8.8
court 8.8
vibrant 8.8
talking 8.6
design 8.4
classroom 8.3
one 8.2
worker 8.1
dancer 8.1
light 8
case 7.9
backhand 7.9
lab coat 7.9
racket 7.9
standing 7.8
serve 7.8
tennis 7.8
colleagues 7.8
corporate 7.7
pretty 7.7
health 7.6
communication 7.6
horizontal 7.5
doctor 7.5
occupation 7.3
lady 7.3
board 7.2
dress 7.2
holiday 7.2
hospital 7.2
icon 7.1
shiny 7.1
family 7.1
sick person 7.1
to 7.1

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

text 99.1
clothing 90.1
person 89
posing 69.4
man 61.7
drawing 61
image 34.3

Face analysis

Amazon

Google

AWS Rekognition

Age 26-36
Gender Male, 99.9%
Happy 95.4%
Sad 1.7%
Calm 0.9%
Surprised 0.8%
Fear 0.6%
Angry 0.4%
Disgusted 0.2%
Confused 0.1%

AWS Rekognition

Age 36-44
Gender Male, 98.8%
Happy 94.3%
Calm 3.2%
Sad 1.6%
Surprised 0.4%
Fear 0.1%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 33-41
Gender Male, 96.6%
Calm 57.4%
Sad 25.2%
Happy 13.9%
Surprised 0.9%
Disgusted 0.9%
Angry 0.8%
Confused 0.4%
Fear 0.4%

AWS Rekognition

Age 24-34
Gender Male, 98.2%
Happy 38.6%
Calm 31.5%
Surprised 21.4%
Sad 3.4%
Fear 2.7%
Disgusted 0.9%
Confused 0.7%
Angry 0.7%

AWS Rekognition

Age 39-47
Gender Male, 76.9%
Calm 95.1%
Surprised 2.3%
Sad 1.1%
Happy 0.4%
Disgusted 0.3%
Fear 0.3%
Confused 0.3%
Angry 0.2%

AWS Rekognition

Age 39-47
Gender Female, 51.7%
Calm 80.5%
Happy 13.9%
Surprised 4%
Sad 0.6%
Confused 0.3%
Angry 0.3%
Disgusted 0.3%
Fear 0.1%

AWS Rekognition

Age 26-36
Gender Female, 98.1%
Calm 95.8%
Sad 2.6%
Happy 0.6%
Surprised 0.4%
Disgusted 0.2%
Angry 0.1%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 27-37
Gender Male, 92.7%
Calm 40.1%
Surprised 27.1%
Happy 27%
Disgusted 1.4%
Angry 1.3%
Fear 1.1%
Confused 0.9%
Sad 0.9%

AWS Rekognition

Age 24-34
Gender Male, 99.5%
Calm 71%
Happy 16.4%
Confused 4%
Surprised 2.7%
Disgusted 1.9%
Fear 1.8%
Sad 1.8%
Angry 0.4%

AWS Rekognition

Age 29-39
Gender Female, 75%
Happy 80.6%
Calm 6.9%
Surprised 4.9%
Fear 4.1%
Disgusted 1.8%
Angry 0.9%
Sad 0.6%
Confused 0.3%

AWS Rekognition

Age 23-31
Gender Male, 98%
Sad 31.1%
Calm 30.7%
Happy 12.1%
Angry 8.7%
Fear 7.3%
Confused 3.6%
Surprised 3.3%
Disgusted 3.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%

Captions

Microsoft

a group of people posing for a photo 77.7%
a group of people posing for the camera 77.6%
a group of people posing for a picture 77.5%

Text analysis

Amazon

3
8
3 O 8 rt ٢٢
rt
O
٢٢