Human Generated Data

Title

Untitled (nine children posed sitting in front of fireplace decorated for Christmas)

Date

1970

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10131

Human Generated Data

Title

Untitled (nine children posed sitting in front of fireplace decorated for Christmas)

People

Artist: Martin Schweig, American 20th century

Date

1970

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Human 98.7
Person 98.7
Person 98.3
Person 98.2
Person 96.7
Person 96.4
Person 96.1
Person 94.2
Person 92.5
People 91
Stage 87.6
Person 87.6
Indoors 84.7
Clothing 84.1
Apparel 84.1
Room 83
Face 70.1
Crowd 69.1
Female 68.8
Text 68.7
Furniture 66.6
Girl 61.6
Shorts 61.2
Portrait 60.9
Photography 60.9
Photo 60.9
Living Room 60.5
Person 58.4

Imagga
created on 2022-01-28

blackboard 30.8
freight car 30.8
car 23
wheeled vehicle 19.8
vintage 19
old 18.8
building 17.8
structure 17.6
people 16.7
grunge 16.2
man 16.1
cinema 16
billboard 15.2
black 15
classroom 14.9
art 14.6
theater 14.1
business 14
room 13.2
antique 13
office 12.6
silhouette 12.4
graphic 12.4
retro 12.3
vehicle 12.1
texture 11.8
paint 11.8
dirty 11.7
space 11.6
pattern 11.6
signboard 11.5
damaged 11.4
person 11.4
male 11.3
sign 11.3
men 11.2
decoration 10.6
text 10.5
computer 10.4
grungy 10.4
design 10.1
symbol 10.1
wall 9.4
finance 9.3
negative 9.3
travel 9.1
aged 9
material 8.9
success 8.8
businessman 8.8
frames 8.8
frame 8.3
letter 8.2
tourism 8.2
rough 8.2
film 8.2
border 8.1
digital 8.1
gymnasium 8.1
history 8
architecture 7.9
noisy 7.9
postmark 7.9
scratches 7.9
designed 7.9
photographic 7.8
paper 7.8
noise 7.8
scratch 7.8
stamp 7.7
rust 7.7
edge 7.7
mask 7.7
mail 7.6
weathered 7.6
historical 7.5
school 7.4
message 7.3
landmark 7.2
screen 7.2
financial 7.1
women 7.1
drawing 7.1

Google
created on 2022-01-28

Microsoft
created on 2022-01-28

text 95.7
person 92.8
clothing 61.7
altar 14.7

Face analysis

Amazon

Google

AWS Rekognition

Age 45-51
Gender Male, 99.8%
Sad 84.5%
Calm 13.2%
Disgusted 0.6%
Fear 0.4%
Happy 0.4%
Confused 0.3%
Surprised 0.3%
Angry 0.2%

AWS Rekognition

Age 21-29
Gender Male, 78.3%
Confused 36.4%
Sad 23.9%
Calm 17.4%
Fear 10.4%
Angry 3.7%
Disgusted 3.3%
Surprised 3%
Happy 1.8%

AWS Rekognition

Age 40-48
Gender Male, 98.7%
Sad 64.6%
Confused 13.9%
Surprised 12.8%
Calm 2.4%
Angry 2.1%
Happy 1.5%
Fear 1.4%
Disgusted 1.3%

AWS Rekognition

Age 25-35
Gender Male, 99.7%
Sad 54.5%
Calm 33.6%
Confused 7.8%
Angry 1%
Surprised 1%
Disgusted 0.9%
Happy 0.8%
Fear 0.5%

AWS Rekognition

Age 24-34
Gender Male, 99.9%
Sad 64.4%
Calm 21.3%
Confused 9.5%
Fear 1.2%
Disgusted 1.2%
Surprised 0.9%
Happy 0.8%
Angry 0.8%

AWS Rekognition

Age 28-38
Gender Female, 71.3%
Sad 63.7%
Calm 28.2%
Surprised 2.6%
Confused 1.5%
Disgusted 1.4%
Fear 1.1%
Angry 0.9%
Happy 0.6%

AWS Rekognition

Age 26-36
Gender Male, 91.6%
Happy 38.3%
Calm 23%
Sad 14.2%
Angry 8.7%
Surprised 6.6%
Confused 4.5%
Disgusted 3.7%
Fear 1%

AWS Rekognition

Age 26-36
Gender Male, 95.6%
Surprised 43%
Calm 18.8%
Sad 13.1%
Confused 6.5%
Angry 5.5%
Disgusted 5.1%
Fear 4.7%
Happy 3.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%

Captions

Microsoft

a group of people standing in front of a crowd 69.8%
a group of people in front of a crowd 69.7%
a group of people in a room 69.6%

Text analysis

Amazon

KODAK
FILM
KODAK SAFETY
SAFETY
JULiE
OL
Bette
DAVID

Google

Bett
OL Bett KODAK S'AFETY FILM
FILM
OL
KODAK
S'AFETY