Human Generated Data

Title

Untitled (nine children posed sitting in front of fireplace decorated for Christmas)

Date

1970

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10136

Human Generated Data

Title

Untitled (nine children posed sitting in front of fireplace decorated for Christmas)

People

Artist: Martin Schweig, American 20th century

Date

1970

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Person 98.7
Human 98.7
Person 98.7
Person 98.2
Person 96.7
Person 94.5
Person 93.3
People 91
Person 91
Indoors 89.9
Face 89.2
Room 88.5
Stage 87.9
Living Room 87.8
Female 83.4
Apparel 76.5
Clothing 76.5
Person 74.4
Person 72.3
Furniture 71.9
Couch 71.9
Girl 71.8
Crowd 70.5
Curtain 63.5
Text 61.9
Kid 60.7
Child 60.7
Woman 60.6
Electronics 60.5
Monitor 60.5
Display 60.5
Screen 60.5
Flooring 59.3
Costume 56.6

Imagga
created on 2022-01-28

blackboard 39.7
classroom 35.8
freight car 30.4
room 30.2
people 25.6
car 22.7
office 22.4
person 22.1
man 20.8
business 20.6
television 19.7
wheeled vehicle 18.4
computer 18.1
cinema 17.4
desk 17.2
education 16.4
businessman 15.9
group 15.3
professional 14.6
corporate 13.7
class 13.5
male 13.5
school 13.3
black 13.2
adult 13.1
board 12.6
work 12.5
theater 12.4
screen 12.2
laptop 12.2
structure 12.2
men 12
monitor 11.9
building 11.8
silhouette 11.6
vehicle 11.6
job 11.5
hand 11.4
modern 11.2
student 11
team 10.7
smile 10.7
happy 10.6
college 10.4
university 10.3
businesswoman 10
night 9.8
teaching 9.7
employee 9.6
billboard 9.4
executive 9.3
teacher 9.2
indoor 9.1
copy space 9
telecommunication system 9
worker 8.9
success 8.8
movie 8.7
smiling 8.7
crowd 8.6
chair 8.5
meeting 8.5
old 8.3
lights 8.3
back 8.3
symbol 8.1
equipment 8
table 8
women 7.9
film 7.9
chalkboard 7.8
hands 7.8
portrait 7.8
travel 7.7
drawing 7.7
sitting 7.7
corporation 7.7
studying 7.7
finance 7.6
communication 7.5
city 7.5
manager 7.4
vintage 7.4
famous 7.4
event 7.4
entertainment 7.4
center 7.1
history 7.1
working 7.1
architecture 7
indoors 7

Google
created on 2022-01-28

Microsoft
created on 2022-01-28

text 99.2
person 87.1
dance 72.5
ballet 56.9

Face analysis

Amazon

Google

AWS Rekognition

Age 26-36
Gender Male, 99.5%
Calm 58.9%
Sad 22.4%
Surprised 8.2%
Disgusted 4.1%
Confused 3.8%
Angry 1.4%
Happy 0.7%
Fear 0.3%

AWS Rekognition

Age 30-40
Gender Male, 58.5%
Sad 39.9%
Calm 38.9%
Happy 9.8%
Disgusted 4.1%
Confused 3%
Angry 1.9%
Fear 1.3%
Surprised 1%

AWS Rekognition

Age 31-41
Gender Male, 96.3%
Sad 58.8%
Confused 28.3%
Calm 11.5%
Surprised 0.5%
Fear 0.5%
Angry 0.2%
Happy 0.2%
Disgusted 0.1%

AWS Rekognition

Age 28-38
Gender Male, 99.5%
Sad 56%
Happy 14.9%
Calm 14.7%
Confused 4.8%
Disgusted 3.7%
Angry 3.3%
Surprised 1.5%
Fear 1.1%

AWS Rekognition

Age 48-56
Gender Male, 99.4%
Happy 43.2%
Calm 29.1%
Sad 14.4%
Confused 3.4%
Angry 3.2%
Surprised 3.1%
Disgusted 2.9%
Fear 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%

Captions

Microsoft

a group of people in a room 83.8%
a screen shot of a group of people in a room 83%
a group of people standing in a room 77.2%

Text analysis

Amazon

5
KODAK
FILM
9
JULIE
KODAK SAFETY
SAFETY
Butter
DEL

Google

Batte
F
FLM
KODAK
Batte KODAK S'AFETY. F FLM KODAK S'AFETY
S'AFETY.
S'AFETY