Human Generated Data

Title

Untitled (family of four on couch with dog)
Date

c. 1950
People

Artist: Lainson Studios,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.21861

Human Generated Data

Title

Untitled (family of four on couch with dog)

People

Artist: Lainson Studios,

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.21861

Machine Generated Data

Tags

Amazon
created on 2022-03-11

Person 99.5
Human 99.5
Person 99.2
Table Lamp 99.1
Lamp 99.1
Person 99
Person 97.8
Clothing 88.9
Apparel 88.9
Furniture 84.6
Tie 80.1
Accessories 80.1
Accessory 80.1
Lighting 77.6
Lampshade 71.6
Face 71.3
Chair 71.2
Portrait 67.8
Photography 67.8
Photo 67.8
People 64.2
Home Decor 56.6

Clarifai
created on 2023-10-22

people 99.9
adult 99
group 98.7
man 97.8
group together 95.9
many 95.8
wear 94.3
woman 93.5
leader 92.1
uniform 91.1
gown (clothing) 83.6
outfit 83
ceremony 82.7
education 79.1
position 78.9
administration 76.8
several 76.4
portrait 76.4
medical practitioner 75.9
actor 75.9

Imagga
created on 2022-03-11

man 36.4
person 35.5
people 35.2
adult 32.5
male 29.1
businessman 27.4
business 26.7
happy 25.7
businesswoman 24.6
professional 24.4
together 22.8
worker 21.9
businesspeople 21.8
couple 21.8
team 21.5
smiling 21
office 20.9
coat 20.8
group 20.2
lab coat 19.6
indoors 19.3
nurse 19.2
sitting 18.9
meeting 18.9
teamwork 18.5
room 18.4
groom 18.2
table 18.2
colleagues 17.5
women 17.4
talking 17.1
desk 17
working 16.8
20s 16.5
portrait 16.2
waiter 15.9
work 15.7
corporate 15.5
casual 15.3
computer 15.2
home 15.2
teacher 15.1
indoor 14.6
40s 14.6
men 14.6
smile 14.3
patient 13.8
happiness 13.3
employee 12.9
medical 12.4
lifestyle 12.3
cheerful 12.2
mature 12.1
hospital 11.9
day 11.8
30s 11.5
job 11.5
executive 11.5
face 11.4
dining-room attendant 11.2
attractive 11.2
health 11.1
successful 11
clothing 11
laptop 10.9
associates 10.8
coworkers 10.8
doctor 10.3
horizontal 10.1
life 10
educator 10
suit 9.9
four people 9.9
illness 9.5
ethnic 9.5
color 9.5
senior 9.4
two 9.3
camera 9.2
drink 9.2
confident 9.1
new 8.9
success 8.9
middle aged 8.8
cooperation 8.7
garment 8.7
four 8.6
grandma 8.5
pretty 8.4
handsome 8
forties 7.8
casual clothing 7.8
lab 7.8
mid adult 7.7
laboratory 7.7
modern 7.7
elderly 7.7
boss 7.7
formal 7.6
uniform 7.6
hand 7.6
enjoying 7.6
friendship 7.5
manager 7.5
presentation 7.4
occupation 7.3
student 7.2
looking 7.2
bright 7.2
romantic 7.1
love 7.1
grandfather 7.1
medicine 7

Google
created on 2022-03-11

Black-and-white 85.3
Style 83.8
Lamp 80.6
Monochrome photography 75
Monochrome 74.9
Event 73.6
Curtain 72.1
Vintage clothing 69.3
Art 68.5
Room 64.6
Sitting 62.2
Stock photography 61.8
Photo caption 61.7
Team 60.9
Font 59.9
Picture frame 59.8
Uniform 57
Chair 54.5

Microsoft
created on 2022-03-11

text 91.1
person 90
clothing 84.7
wedding dress 81.6
bride 74
black and white 67.5
woman 64.7
man 54.3

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 36-44
Gender Female, 99.5%
Calm 99.8%
Happy 0.1%
Sad 0.1%
Surprised 0%
Confused 0%
Angry 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 51-59
Gender Female, 81.2%
Calm 72.7%
Sad 26.2%
Happy 0.5%
Confused 0.2%
Angry 0.1%
Disgusted 0.1%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 21-29
Gender Female, 97.2%
Calm 99.8%
Sad 0.1%
Surprised 0%
Disgusted 0%
Confused 0%
Happy 0%
Fear 0%
Angry 0%

AWS Rekognition

Age 27-37
Gender Male, 53.5%
Calm 45.5%
Sad 36.5%
Angry 5.9%
Happy 4%
Disgusted 3.2%
Confused 2.7%
Fear 1.1%
Surprised 1.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Tie
Person 99.5%
Person 99.2%
Person 99%
Person 97.8%
Tie 80.1%

Categories

Imagga

paintings art 99.8%

Captions

Microsoft
created on 2022-03-11

an old photo of a person 59.9%
a group of people in a room 59.8%
a group of people around each other 49.8%

Text analysis

Amazon

TOS
M3-Y3A-X