Human Generated Data

Title

Untitled (nine children posed sitting in front of fireplace decorated for Christmas)
Date

1970
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10134

Human Generated Data

Title

Untitled (nine children posed sitting in front of fireplace decorated for Christmas)

People

Artist: Martin Schweig, American 20th century

Date

1970

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10134

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Person 98.6
Human 98.6
Person 97.9
Person 97
Person 97
Person 96
Person 95.4
Person 93.8
Person 93.5
Person 92.6
Room 85.1
Indoors 85.1
Living Room 84.8
Stage 83.6
People 80.1
Couch 79
Furniture 79
Person 75.5
Shorts 74.2
Clothing 74.2
Apparel 74.2
Female 71.2
Painting 65.6
Art 65.6
Girl 65.4
Meal 65.3
Food 65.3
Flooring 63.2
Monitor 62.9
Electronics 62.9
Display 62.9
Screen 62.9
Face 62.1
Kid 61.9
Child 61.9
Curtain 59.3
Crowd 57.8
Leisure Activities 57
Sitting 56
Classroom 55.3
School 55.3

Clarifai
created on 2023-10-27

people 99.9
adult 98
woman 96.9
wear 96.3
group 95.9
man 94.4
group together 93.4
many 92.1
child 92
education 89.6
sit 87.9
indoors 85.8
room 85.7
music 85.1
position 81.9
audience 81.6
dancing 80.7
theater 80.7
leader 80.5
administration 80

Imagga
created on 2022-01-28

freight car 100
car 100
wheeled vehicle 100
vehicle 64
conveyance 33.8
blackboard 23.2
silhouette 18.2
people 17.8
business 17
education 16.4
person 14.8
black 13.8
class 13.5
symbol 12.8
man 12.8
chalkboard 12.7
school 12.6
office 12.1
male 12
finance 11.8
board 11.7
crowd 11.5
design 11.2
classroom 11.2
vintage 10.7
hand 10.6
businessman 10.6
computer 10.6
digital 10.5
technology 10.4
men 10.3
screen 10.1
modern 9.8
group 9.7
room 9.5
icon 9.5
cinema 9.4
television 9.3
lights 9.3
student 9
financial 8.9
university 8.9
success 8.8
audience 8.8
teaching 8.8
monitor 8.7
teacher 8.7
drawing 8.6
college 8.5
grunge 8.5
art 8.5
human 8.2
copy space 8.1
film 8
graphic 8
idea 8
night 8
information 8
movie 7.7
wall 7.7
patriotic 7.7
old 7.7
marketing 7.6
nation 7.6
event 7.4
entertainment 7.4
team 7.2
architecture 7

Google
created on 2022-01-28

Picture frame 93.1
Rectangle 85.8
Font 81.8
Art 80.6
Building 72.6
Monochrome photography 72.4
Curtain 72.2
Event 72
Monochrome 71.6
Visual arts 67.5
Room 67.1
History 66.3
Painting 66.1
Stock photography 62.7
Illustration 60
Still life photography 58.8
Photo caption 57.1
Collection 56.8
Facade 56.1
Interior design 54.5

Microsoft
created on 2022-01-28

text 99.7
person 90.2
dance 63.7

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 30-40
Gender Male, 53.8%
Sad 70.8%
Calm 18.3%
Confused 3.5%
Surprised 2.5%
Disgusted 2.5%
Happy 1.1%
Angry 0.9%
Fear 0.5%

AWS Rekognition

Age 43-51
Gender Male, 99.9%
Sad 97.7%
Confused 1.5%
Angry 0.2%
Disgusted 0.2%
Calm 0.2%
Fear 0.1%
Happy 0.1%
Surprised 0.1%

AWS Rekognition

Age 33-41
Gender Male, 78.5%
Sad 71.4%
Confused 11.7%
Calm 10.6%
Happy 2.5%
Disgusted 1.3%
Surprised 1%
Angry 0.8%
Fear 0.6%

AWS Rekognition

Age 33-41
Gender Male, 66.2%
Sad 52.7%
Calm 30.8%
Confused 12.8%
Fear 1%
Disgusted 1%
Angry 0.6%
Surprised 0.5%
Happy 0.5%

AWS Rekognition

Age 30-40
Gender Male, 98.8%
Sad 92.6%
Happy 3.1%
Confused 1.7%
Disgusted 1.1%
Calm 0.5%
Angry 0.5%
Surprised 0.2%
Fear 0.2%

AWS Rekognition

Age 38-46
Gender Male, 99.4%
Calm 44.4%
Sad 36.6%
Happy 12%
Surprised 3%
Confused 2.4%
Disgusted 0.8%
Angry 0.5%
Fear 0.2%

AWS Rekognition

Age 45-51
Gender Male, 99.7%
Calm 64.4%
Sad 25.2%
Confused 5.4%
Surprised 2%
Disgusted 1%
Fear 0.9%
Angry 0.8%
Happy 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Painting
Person 98.6%
Person 97.9%
Person 97%
Person 97%
Person 96%
Person 95.4%
Person 93.8%
Person 93.5%
Person 92.6%
Person 75.5%
Painting 65.6%

Text analysis

Amazon

KODAK
FILM
KODAK SAFETY
SAFETY
S'AFETY
JULiE
Pette

Google

FILM KODAK S'AFETY FILM KODAK S'AFETY
FILM
KODAK
S'AFETY