Human Generated Data

Title

Untitled (nine children posed sitting in front of fireplace decorated for Christmas)
Date

1970
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10139

Human Generated Data

Title

Untitled (nine children posed sitting in front of fireplace decorated for Christmas)

People

Artist: Martin Schweig, American 20th century

Date

1970

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Person 98.9
Human 98.9
Person 97.6
Person 95.7
Person 95.1
Person 94.9
Person 93.3
Indoors 92.3
Room 91.4
Person 88.1
People 87.8
Stage 87.8
Person 85.4
Living Room 84.4
Female 84.3
Face 79.6
Person 77.2
Crowd 70.7
Girl 70.1
Furniture 68.9
Curtain 66.1
Woman 63.1
Apparel 61.5
Clothing 61.5
Portrait 60.4
Photo 60.4
Photography 60.4
Couch 57
Bed 56.9
Text 56.7
Bedroom 56.2
Child 55.9
Kid 55.9

Imagga
created on 2022-01-29

blackboard 29.7
people 27.3
man 26.2
person 23.8
television 22.7
classroom 20.9
male 20.5
business 18.8
room 18.6
businessman 18.5
silhouette 16.5
cinema 14.3
symbol 14.1
telecommunication system 14.1
men 13.7
group 13.7
crowd 13.4
office 13.4
structure 13.2
audience 12.7
theater 12.6
lights 12
happy 11.9
cheering 11.7
team 11.6
adult 11.5
patriotic 11.5
black 11.4
building 11.4
nation 11.3
education 11.2
flag 11.2
women 11.1
nighttime 10.8
stadium 10.7
job 10.6
vibrant 10.5
couple 10.4
university 9.9
desk 9.6
design 9.6
icon 9.5
water 9.3
teamwork 9.3
school 9.1
hand 9.1
computer 9.1
old 9
board 9
freight car 9
teacher 8.7
class 8.7
boss 8.6
sitting 8.6
bright 8.6
finance 8.4
student 8.4
vivid 8.4
indoor 8.2
businesswoman 8.2
history 8
success 8
chair 7.9
work 7.8
happiness 7.8
professional 7.8
youth 7.7
two 7.6
vintage 7.4
event 7.4
smile 7.1
night 7.1
love 7.1

Google
created on 2022-01-29

Picture frame 88.4
Rectangle 86.3
Style 83.8
Black-and-white 82.6
Art 82.3
Font 81.8
Curtain 76.3
Building 74.3
Snapshot 74.3
Monochrome photography 73.6
Monochrome 73.3
Event 72.6
Visual arts 68.6
Painting 67.6
Illustration 67.6
Room 67.3
History 65.1
Stock photography 63.7
Suit 62.8
Symmetry 59.6

Microsoft
created on 2022-01-29

text 93.1
person 89.7
indoor 86.9
clothing 69.1
church 53.8
candle 51.3

Face analysis

Amazon

Google

AWS Rekognition

Age 45-51
Gender Male, 99.9%
Sad 75.6%
Calm 9.4%
Surprised 4.5%
Confused 3.2%
Disgusted 2.2%
Angry 2.1%
Happy 1.7%
Fear 1.3%

AWS Rekognition

Age 33-41
Gender Male, 96.7%
Calm 78.3%
Sad 8%
Disgusted 4.9%
Surprised 4.5%
Confused 2.8%
Angry 0.6%
Fear 0.5%
Happy 0.3%

AWS Rekognition

Age 45-53
Gender Male, 99.2%
Calm 71%
Sad 9.2%
Confused 7.5%
Disgusted 6.5%
Angry 2.1%
Surprised 1.8%
Happy 1.2%
Fear 0.6%

AWS Rekognition

Age 33-41
Gender Male, 99.9%
Sad 96.7%
Calm 2.5%
Fear 0.3%
Confused 0.2%
Happy 0.1%
Angry 0.1%
Surprised 0.1%
Disgusted 0%

AWS Rekognition

Age 25-35
Gender Male, 72.3%
Sad 87.9%
Happy 3.4%
Disgusted 2.5%
Confused 1.9%
Calm 1.7%
Surprised 0.9%
Angry 0.9%
Fear 0.8%

AWS Rekognition

Age 47-53
Gender Female, 50.9%
Calm 96.6%
Happy 1.3%
Sad 0.8%
Disgusted 0.5%
Surprised 0.3%
Confused 0.2%
Angry 0.2%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%

Captions

Microsoft

a group of people in a room 87.7%
a group of people standing in front of a crowd 67%
a group of people in front of a crowd 66.9%

Text analysis

Amazon

KODAK
FILM
JULIE
KODAK SAFETY
SAFETY
Botte
David
Il

Google

KODAK S'AFETY FILM
KODAK
S'AFETY
FILM