Human Generated Data

Title

Untitled (three children in formal attire)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17268

Human Generated Data

Title

Untitled (three children in formal attire)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17268

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Furniture 99.9
Clothing 99.8
Apparel 99.8
Chair 99.5
Person 98.9
Human 98.9
Person 97.8
Helmet 96.3
Coat 88.8
Suit 88.2
Overcoat 88.2
Home Decor 85.4
Table 64
Face 60.3
Tuxedo 59.4
Female 58.6
Dining Table 58.2
Armchair 58.1
Couch 57.2
Indoors 55.3

Clarifai
created on 2023-10-28

people 99.9
man 95.9
group 95.9
adult 95.6
two 95.5
wedding 95.2
woman 94.6
leader 89.7
group together 89.2
three 89.1
groom 88.3
actress 87
administration 86.5
room 86.3
monochrome 85.9
music 85.5
wear 85.2
actor 84.9
family 84
outfit 83.3

Imagga
created on 2022-02-26

man 39.7
male 38.5
person 35.7
people 34.6
professional 26.5
businessman 25.6
adult 25.6
happy 23.2
business 21.9
office 21.8
smiling 21.7
couple 20
patient 20
corporate 19.8
brass 19.6
worker 19.3
room 19.3
businesswoman 18.2
men 18
meeting 17.9
group 17.7
together 17.5
work 16.5
world 16.4
executive 16.3
sitting 16.3
wind instrument 16
team 15.2
businesspeople 15.2
teacher 15.1
working 15
senior 15
teamwork 14.8
waiter 14.7
home 14.4
portrait 14.2
women 14.2
happiness 14.1
indoors 14.1
job 13.3
medical 13.2
mature 13
family 12.5
talking 12.4
cornet 12.3
life 12.3
occupation 11.9
musical instrument 11.9
day 11.8
suit 11.7
40s 11.7
lifestyle 11.6
table 11.3
computer 11.2
two 11
laptop 10.9
mother 10.9
barbershop 10.8
holding 10.7
colleagues 10.7
employee 10.6
partnership 10.6
husband 10.5
case 10.4
hospital 10.4
looking 10.4
manager 10.2
groom 10.2
nurse 10.2
successful 10.1
dress 9.9
new 9.7
partner 9.7
mid adult 9.7
elderly 9.6
education 9.5
love 9.5
desk 9.4
doctor 9.4
student 9.4
dining-room attendant 9.4
company 9.3
smile 9.3
communication 9.2
indoor 9.1
confident 9.1
old 9.1
care 9.1
color 8.9
coworkers 8.8
father 8.8
hands 8.7
boss 8.6
sick person 8.5
shop 8.5
modern 8.4
study 8.4
hand 8.4
wedding 8.3
cheerful 8.1
success 8
standing 7.8
bride 7.8
retirement 7.7
casual 7.6
ethnic 7.6
wife 7.6
career 7.6
laughing 7.6
handsome 7.1
face 7.1
hairdresser 7

Google
created on 2022-02-26

Black-and-white 85.4
Style 83.9
Curtain 79.8
Monochrome photography 77.7
Monochrome 77.2
Hat 74.4
Vintage clothing 71.7
Event 70.5
Suit 70.5
Chair 70.3
Room 67.3
Stock photography 63.8
Classic 63.4
Formal wear 59.7
History 58.8
Art 53.9
Visual arts 52.2

Microsoft
created on 2022-02-26

furniture 93.5
black and white 90.4
person 89.7
clothing 87.4
chair 78.8
text 69.2
footwear 63.3
table 59.5
woman 52.3
clothes 16.6

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 36-44
Gender Male, 99.7%
Happy 59.9%
Sad 17%
Calm 12.3%
Surprised 4.2%
Disgusted 2.6%
Angry 1.5%
Confused 1.3%
Fear 1.1%

AWS Rekognition

Age 30-40
Gender Female, 61.6%
Happy 94.7%
Calm 2.9%
Surprised 1.7%
Fear 0.2%
Angry 0.2%
Disgusted 0.1%
Sad 0.1%
Confused 0%

AWS Rekognition

Age 18-26
Gender Male, 99.7%
Calm 99.1%
Sad 0.4%
Happy 0.2%
Angry 0.1%
Confused 0.1%
Surprised 0.1%
Disgusted 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Chair
Person
Helmet
Couch
Chair 99.5%
Person 98.9%
Person 97.8%
Helmet 96.3%
Couch 57.2%

Categories

Captions

Text analysis

Amazon

3
SALETA
DUSCO SALETA ЫГИ
DUSCO
ЫГИ

Google

MJ17 YT3RA2 0
MJ17
YT3RA2
0