Human Generated Data

Title

Untitled (nine children posed sitting in front of fireplace decorated with stockings)

Date

1968

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10108

Human Generated Data

Title

Untitled (nine children posed sitting in front of fireplace decorated with stockings)

People

Artist: Martin Schweig, American 20th century

Date

1968

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Person 99.3
Human 99.3
Person 99.2
Person 98.8
Person 97.7
Person 97.2
Person 97.2
Person 97
Person 95.7
Indoors 91.7
Room 90.9
Person 89.4
Living Room 87.6
People 85.6
Face 72.8
Female 71.5
Clothing 69
Apparel 69
Text 64.5
Girl 63.4
Portrait 63
Photo 63
Photography 63
Furniture 62.3
Curtain 62
Couch 58.5
Crowd 55.6

Imagga
created on 2022-01-28

blackboard 28.3
television 23.3
freight car 22.2
classroom 21.6
people 20.6
room 19.9
man 18.1
monitor 18.1
person 17.4
office 17
car 16.6
business 15.8
black 15
male 14.9
wheeled vehicle 14.7
old 13.2
silhouette 12.4
vintage 12.4
telecommunication system 12.4
screen 12.3
computer 11.6
school 11.1
university 10.8
art 10.6
group 10.5
education 10.4
teacher 10.1
class 9.6
design 9.6
symbol 9.4
grunge 9.4
building 9.3
modern 9.1
team 8.9
one 8.9
cinema 8.9
vehicle 8.9
businessman 8.8
happy 8.8
structure 8.7
men 8.6
youth 8.5
student 8.5
finance 8.4
board 8.1
history 8
night 8
chalkboard 7.8
couple 7.8
equipment 7.8
desk 7.7
hand 7.6
indoor 7.3
graphic 7.3
film 7.3
paint 7.2
success 7.2
looking 7.2
professional 7.1
architecture 7

Google
created on 2022-01-28

Microsoft
created on 2022-01-28

text 99.1
person 79.5
black and white 55.8

Face analysis

Amazon

Google

AWS Rekognition

Age 49-57
Gender Male, 94.8%
Sad 96.8%
Calm 2.5%
Happy 0.3%
Confused 0.2%
Angry 0.1%
Disgusted 0.1%
Fear 0.1%
Surprised 0%

AWS Rekognition

Age 23-33
Gender Female, 73.4%
Sad 66.6%
Calm 16.7%
Disgusted 5%
Confused 4.1%
Surprised 3.2%
Happy 2.1%
Angry 1.3%
Fear 1%

AWS Rekognition

Age 33-41
Gender Male, 50.3%
Calm 78.4%
Happy 10.5%
Sad 5.1%
Fear 2.6%
Confused 1.2%
Angry 1%
Surprised 0.8%
Disgusted 0.5%

AWS Rekognition

Age 35-43
Gender Male, 98.6%
Sad 83.3%
Calm 6.9%
Confused 3.8%
Happy 2.3%
Disgusted 1.8%
Angry 0.9%
Surprised 0.6%
Fear 0.6%

AWS Rekognition

Age 47-53
Gender Male, 93.6%
Sad 86.3%
Confused 3.3%
Disgusted 3.3%
Fear 2.6%
Calm 1.7%
Happy 1.2%
Angry 1%
Surprised 0.6%

AWS Rekognition

Age 40-48
Gender Male, 99.4%
Sad 87.1%
Calm 9.4%
Confused 1.3%
Fear 1.3%
Happy 0.4%
Disgusted 0.3%
Angry 0.1%
Surprised 0.1%

AWS Rekognition

Age 26-36
Gender Male, 97.3%
Sad 86.2%
Calm 9.3%
Angry 1.3%
Confused 1.3%
Disgusted 0.9%
Surprised 0.6%
Fear 0.3%
Happy 0.2%

AWS Rekognition

Age 38-46
Gender Male, 97.7%
Sad 99.7%
Happy 0.1%
Fear 0%
Confused 0%
Calm 0%
Angry 0%
Disgusted 0%
Surprised 0%

AWS Rekognition

Age 48-56
Gender Female, 97.1%
Calm 82.6%
Happy 7.9%
Sad 6.5%
Disgusted 0.8%
Surprised 0.7%
Angry 0.6%
Confused 0.5%
Fear 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%

Captions

Microsoft

a group of people in a room 73.6%
a group of people standing in a room 65.1%
a group of people on a stage 44%

Text analysis

Amazon

FILM
KODAK
KODAK SAFET
KODAK SAFETY
SAFET
SAFETY
JULIE
SAUDI
Anty

Google

FILM
KODAK
JULIE KODAK S'AFETY FILM KODAK S'AFET FILM
JULIE
S'AFETY
S'AFET