Human Generated Data

Title

Untitled (family with two girls and baby posed sitting on living room couch)
Date

1958
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9623

Human Generated Data

Title

Untitled (family with two girls and baby posed sitting on living room couch)

People

Artist: Martin Schweig, American 20th century

Date

1958

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9623

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Chair 100
Furniture 100
Person 98.4
Human 98.4
Person 97.5
Person 97.3
Clothing 97.2
Apparel 97.2
Tie 95.3
Accessories 95.3
Accessory 95.3
Person 93.8
Shorts 88.9
Face 88.1
Indoors 75
Table 71.5
Female 68.4
Portrait 67.7
Photography 67.7
Photo 67.7
People 65.3
Room 65.1
Shoe 63.5
Footwear 63.5
Kid 60.1
Child 60.1
Suit 56.7
Coat 56.7
Overcoat 56.7
Sailor Suit 56.6
Girl 55.5

Clarifai
created on 2023-10-27

people 99.6
adult 97.5
woman 97.3
man 97
group together 93.9
monochrome 93.6
group 91.6
recreation 90.9
adolescent 88.6
indoors 88.6
sitting 88.2
sit 86.2
portrait 85.2
competition 83.8
athlete 83.6
sports equipment 83.4
horizontal 83.2
facial expression 81.7
friendship 79.8
sport 78.3

Imagga
created on 2022-01-23

businessman 39.7
man 39.7
person 38.7
business 35.2
male 32.6
people 32.4
professional 31.7
adult 30.9
corporate 28.4
office 27.8
happy 25.1
men 24
meeting 23.6
group 23.4
executive 23.3
women 22.1
businesswoman 21.8
team 21.5
sitting 21.5
manager 21.4
teacher 21.4
room 20.6
job 20.4
smiling 20.3
table 19.9
worker 19.8
work 19.6
teamwork 19.5
talking 19
businesspeople 19
communication 18.5
laptop 18.2
together 17.5
suit 17.1
portrait 16.2
smile 15.7
modern 15.4
computer 15.2
lifestyle 15.2
working 15
success 14.5
boss 14.4
desk 14.2
happiness 13.3
successful 12.8
casual 12.7
patient 12.1
conference 11.7
classroom 11.6
chair 11.6
employee 11.4
educator 11.2
looking 11.2
company 11.2
two 11
indoor 11
building 10.8
colleagues 10.7
career 10.4
finance 10.1
clothing 9.8
cheerful 9.8
couple 9.6
ethnic 9.5
hall 9.5
day 9.4
training 9.2
board 9.2
hand 9.1
attractive 9.1
holding 9.1
outdoors 9
interior 8.8
partnership 8.6
senior 8.4
equipment 8.3
case 8
home 8
indoors 7.9
education 7.8
40s 7.8
color 7.8
leader 7.7
diversity 7.7
health 7.6
formal 7.6
plan 7.6
smart 7.5
one person 7.5
human 7.5
presentation 7.4
mature 7.4
document 7.4
phone 7.4
nurse 7.2
handsome 7.1
sport 7.1
sports equipment 7

Google
created on 2022-01-23

Shorts 96.3
Sports uniform 93.3
Black-and-white 84.8
Style 83.9
Player 80.5
Sportswear 76.9
Monochrome photography 74.6
Font 74.4
Monochrome 73.6
Room 69.6
Knee 67.6
Happy 66.3
Art 65.7
Uniform 64.7
Sitting 63.8
Stock photography 63.2
Vintage clothing 61.8
Photo caption 61.4
Team 60.8
T-shirt 60.5

Microsoft
created on 2022-01-23

person 99.7
text 98.3
man 96.7
outdoor 85.1
posing 84.4
footwear 84.2
clothing 81.2
smile 56.8

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 27-37
Gender Female, 99.5%
Happy 88.2%
Surprised 9.3%
Calm 1.5%
Disgusted 0.3%
Fear 0.2%
Sad 0.2%
Angry 0.2%
Confused 0.1%

AWS Rekognition

Age 27-37
Gender Male, 99.7%
Sad 97.3%
Calm 1.2%
Happy 0.9%
Surprised 0.1%
Angry 0.1%
Fear 0.1%
Confused 0.1%
Disgusted 0.1%

AWS Rekognition

Age 19-27
Gender Female, 99.6%
Happy 37%
Sad 20.9%
Calm 16.8%
Surprised 9.8%
Fear 5.8%
Angry 5%
Disgusted 3.2%
Confused 1.5%

AWS Rekognition

Age 12-20
Gender Male, 67.3%
Surprised 72.8%
Calm 16%
Fear 4.5%
Angry 2.4%
Sad 2%
Disgusted 1%
Happy 0.9%
Confused 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Tie
Shoe
Person 98.4%
Person 97.5%
Person 97.3%
Person 93.8%
Tie 95.3%
Shoe 63.5%

Categories

Imagga

people portraits 93.3%
paintings art 5.6%

Text analysis

Amazon

25203

Google

MJI7-
MJI7-