Human Generated Data

Title

Untitled (nine children posed sitting in front of fireplace decorated for Christmas)

Date

1970

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10141

Human Generated Data

Title

Untitled (nine children posed sitting in front of fireplace decorated for Christmas)

People

Artist: Martin Schweig, American 20th century

Date

1970

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Person 98.6
Human 98.6
Person 98
Person 97
Person 95.3
Person 94.5
Person 93.4
Stage 92.3
Indoors 91.8
Clothing 90.4
Apparel 90.4
Room 90.3
Person 89.3
Face 88.4
Person 87.7
People 86.6
Living Room 85.7
Female 84.6
Interior Design 82.7
Couch 82.5
Furniture 82.5
Person 80.1
Meal 76.1
Food 76.1
Shorts 74.3
Kid 70.9
Child 70.9
Girl 68.6
Curtain 68.4
Monitor 66.1
Display 66.1
Screen 66.1
Electronics 66.1
Dress 64.9
Photo 63.5
Portrait 63.5
Photography 63.5
Crowd 63.5
Person 62.7
Woman 60.5

Imagga
created on 2022-01-29

freight car 65.5
car 48.9
television 41.7
wheeled vehicle 39.7
blackboard 25.8
vehicle 24.9
office 22.3
business 21.2
screen 20.1
classroom 20
computer 19.7
monitor 19.5
billboard 19.2
people 18.9
telecommunication system 18.8
black 16.8
man 16.8
room 16.5
structure 15.6
school 15.5
person 15.1
signboard 14.8
education 14.7
cinema 14
board 13.6
class 13.5
male 13.5
modern 13.3
businessman 13.2
vintage 13.2
conveyance 13.1
film 12.8
chalkboard 12.7
finance 12.7
movie 12.6
entertainment 12
old 11.8
teacher 11.7
broadcasting 11.5
desk 11.4
digital 11.3
theater 11
indoor 10.9
student 10.9
design 10.7
university 10.6
college 10.4
building 10.2
grunge 10.2
happy 10
success 9.6
technology 9.6
graphic 9.5
laptop 9.2
hand 9.1
art 9.1
silhouette 9.1
dirty 9
working 8.8
chalk 8.8
smile 8.5
equipment 8.4
one 8.2
retro 8.2
copy space 8.1
symbol 8.1
team 8.1
group 8.1
financial 8
work 7.8
telecommunication 7.8
lesson 7.8
teaching 7.8
collage 7.7
professional 7.7
exam 7.7
texture 7.6
chair 7.6
frame 7.5
study 7.5
rough 7.3
paint 7.2
border 7.2
smiling 7.2
adult 7.1
information 7.1

Google
created on 2022-01-29

Microsoft
created on 2022-01-29

text 99.2
person 88.1

Face analysis

Amazon

Google

AWS Rekognition

Age 45-51
Gender Male, 99.8%
Sad 95.3%
Confused 3.5%
Calm 0.3%
Disgusted 0.3%
Angry 0.2%
Fear 0.2%
Happy 0.1%
Surprised 0.1%

AWS Rekognition

Age 42-50
Gender Male, 97.8%
Sad 98.2%
Calm 1.2%
Confused 0.4%
Fear 0.1%
Happy 0.1%
Angry 0%
Disgusted 0%
Surprised 0%

AWS Rekognition

Age 28-38
Gender Female, 59.8%
Sad 81.7%
Calm 10.3%
Confused 3.3%
Disgusted 1.9%
Surprised 1%
Angry 0.7%
Happy 0.6%
Fear 0.5%

AWS Rekognition

Age 28-38
Gender Male, 94.2%
Calm 90.6%
Sad 5.8%
Disgusted 1.3%
Surprised 0.6%
Happy 0.6%
Angry 0.5%
Confused 0.5%
Fear 0.2%

AWS Rekognition

Age 40-48
Gender Male, 89.9%
Sad 75.6%
Calm 8.1%
Happy 6.5%
Confused 5.2%
Disgusted 1.7%
Angry 1.3%
Surprised 0.9%
Fear 0.8%

AWS Rekognition

Age 24-34
Gender Female, 74.6%
Happy 75.1%
Calm 12%
Surprised 3.9%
Fear 3.4%
Sad 3%
Disgusted 1.4%
Confused 0.7%
Angry 0.6%

AWS Rekognition

Age 25-35
Gender Male, 98.5%
Calm 61.5%
Sad 30.4%
Confused 3.7%
Fear 1.3%
Angry 1.1%
Happy 0.8%
Disgusted 0.7%
Surprised 0.6%

AWS Rekognition

Age 47-53
Gender Male, 99.6%
Calm 88.8%
Sad 3.5%
Happy 3.2%
Surprised 2.9%
Confused 0.7%
Disgusted 0.4%
Angry 0.3%
Fear 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%

Captions

Microsoft

a group of people in a room 80.6%
a group of people in front of a television 46.5%
a group of people standing in front of a television 45%

Text analysis

Amazon

KODAK
4
FILM
FIL
SAFETY
KODAK SAFETY
JULiE
IS
Bette

Google

bets
KODAK
4. bets JULIE KODAK S'AFETY FILM KODAK S'AFETY FIL
S'AFETY
FIL
4.
JULIE
FILM