Human Generated Data

Title

Untitled (portrait of three men and little boy)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16400

Human Generated Data

Title

Untitled (portrait of three men and little boy)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16400

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Person 98.9
Human 98.9
Person 98.3
Person 97.9
Tie 97.2
Accessories 97.2
Accessory 97.2
Person 95.6
Sitting 90.8
Clothing 90.1
Apparel 90.1
Tie 89
Crowd 81.1
Nature 77.9
People 72.4
Coat 67.6
Linen 65.4
Home Decor 65.4
Suit 65.4
Overcoat 65.4
Audience 56.9
Text 55.9
Furniture 55.7

Clarifai
created on 2023-10-28

people 99.9
group 99.5
man 99.2
adult 98.9
leader 98.4
group together 96.9
ceremony 92.5
administration 90
actor 90
many 88.3
chair 87.3
woman 86.9
wedding 86.9
veil 85.2
several 84.1
interaction 84
indoors 83.6
monochrome 83.3
league 81.8
meeting 81.5

Imagga
created on 2022-02-11

man 47.1
male 41.2
person 39.3
people 36.8
businessman 36.2
business 35.2
adult 32.6
office 32.1
professional 28.7
executive 28.3
meeting 28.3
colleagues 25.3
businesspeople 24.7
indoors 24.6
smiling 24.6
team 24.2
businesswoman 23.6
senior 23.4
corporate 23.2
happy 23.2
men 23.2
talking 22.8
patient 22.2
couple 21.8
group 21
worker 20.9
sitting 20.6
women 19.8
teacher 19.4
home 18.4
life 18.1
lifestyle 18.1
job 17.7
room 17.7
teamwork 17.6
table 17.3
desk 17
mature 16.7
together 16.7
working 15.9
work 15.7
smile 15.7
20s 15.6
portrait 15.5
casual 15.3
medical 15
happiness 14.1
cheerful 13.8
coworkers 13.8
occupation 13.8
40s 13.6
educator 13.5
grandfather 13
associates 12.8
indoor 12.8
suit 12.7
30s 12.5
four 12.5
elderly 12.5
doctor 12.2
inside 12
old 11.9
nurse 11.8
hospital 11.6
mid adult 11.6
career 11.4
computer 11.2
manager 11.2
kin 10.8
employee 10.7
discussion 10.7
handsome 10.7
corporation 10.6
color 10.6
modern 10.5
health 10.4
two 10.2
camera 10.2
horizontal 10.1
laptop 10
discussing 9.8
looking 9.6
formal 9.6
waiter 9.5
illness 9.5
ethnic 9.5
presentation 9.3
communication 9.2
face 9.2
attractive 9.1
business people 8.9
collaboration 8.9
success 8.9
casual clothing 8.8
conference 8.8
thirties 8.8
two people 8.8
retired 8.7
clothing 8.6
twenties 8.6
mother 8.6
company 8.4
treatment 8.3
successful 8.2
care 8.2
family 8
boardroom 7.9
four people 7.9
sick person 7.9
day 7.9
forties 7.9
businessmen 7.8
case 7.7
busy 7.7
jacket 7.7
diversity 7.7
retirement 7.7
profession 7.7
staff 7.7
clinic 7.5
document 7.3
confident 7.3
love 7.1
to 7.1
interior 7.1
medicine 7

Google
created on 2022-02-11

Microsoft
created on 2022-02-11

man 98.2
person 95.7
text 95.6
clothing 95.4
outdoor 86.4
standing 84.6
posing 75.6
human face 68.8
old 65.5
smile 52.5

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 36-44
Gender Male, 99.8%
Happy 98.7%
Angry 0.3%
Surprised 0.3%
Calm 0.2%
Disgusted 0.2%
Sad 0.1%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 24-34
Gender Male, 98.9%
Sad 39%
Surprised 29.3%
Calm 10.4%
Fear 8.9%
Disgusted 7.4%
Angry 3%
Happy 1%
Confused 0.8%

AWS Rekognition

Age 42-50
Gender Male, 99.6%
Surprised 36.4%
Calm 30.3%
Happy 14.8%
Fear 11.7%
Confused 2.3%
Angry 1.9%
Disgusted 1.7%
Sad 1.1%

AWS Rekognition

Age 48-54
Gender Male, 79%
Happy 80.5%
Surprised 17.5%
Confused 0.5%
Calm 0.4%
Disgusted 0.3%
Fear 0.3%
Angry 0.2%
Sad 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Tie
Person 98.9%
Person 98.3%
Person 97.9%
Person 95.6%
Tie 97.2%
Tie 89%

Categories

Imagga

paintings art 62.2%
people portraits 36.2%

Text analysis

Amazon

ODVK
ODVK SWEET
SWEET