Human Generated Data

Title

Untitled (family portrait in living room)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17076

Human Generated Data

Title

Untitled (family portrait in living room)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17076

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99.5
Human 99.5
Person 99.3
Person 99
Person 98.9
Person 98.5
Clothing 98.1
Apparel 98.1
Person 97.4
Helmet 94.6
Couch 75
Furniture 75
Face 72.8
Hat 66.5
Female 65.8
People 65.7
Portrait 62.1
Photography 62.1
Photo 62.1
Text 56.3
Bonnet 55.6

Clarifai
created on 2023-10-28

people 99.7
group 98.8
group together 98.2
woman 97.8
man 97.8
adult 97.6
monochrome 96.4
five 93.8
three 86.8
four 86.6
portrait 86.2
child 85.8
education 82.7
several 81.4
teacher 81.2
room 80.4
indoors 80.3
recreation 78.7
medical practitioner 77.9
school 77.3

Imagga
created on 2022-02-26

teacher 50.8
man 45.7
professional 42.9
person 42.8
male 37.6
office 34.8
people 34
adult 33.8
educator 30.8
desk 30.4
businessman 30
smiling 29
business 28.6
room 28.2
happy 28.2
sitting 26.6
group 26.6
table 25.8
meeting 25.5
work 25.1
executive 24.8
women 23.7
classroom 23
corporate 22.4
teamwork 22.3
laptop 22
team 21.5
indoors 21.1
together 21
businesswoman 20.9
education 20.8
men 20.6
working 20.3
computer 20.1
job 19.5
businesspeople 19
smile 18.5
modern 18.2
talking 18.1
suit 18
worker 17.5
nurse 16.6
colleagues 16.5
student 16.4
portrait 16.2
conference 15.6
success 15.3
manager 14.9
couple 14.8
lifestyle 13.7
successful 13.7
indoor 13.7
teaching 13.6
home 13.6
communication 13.4
school 13
presentation 13
mature 13
board 12.7
patient 12.6
class 12.5
boss 12.4
interior 12.4
learning 12.2
confident 11.8
life 11.4
looking 11.2
hospital 10.4
technology 10.4
senior 10.3
two 10.2
blackboard 10
diversity 9.6
formal 9.6
color 9.5
study 9.3
hall 9.2
explaining 8.9
to 8.9
medical 8.8
students 8.8
discussion 8.8
staff 8.7
boy 8.7
mid adult 8.7
leader 8.7
case 8.7
career 8.5
attractive 8.4
company 8.4
coffee 8.3
phone 8.3
holding 8.3
cheerful 8.1
chair 8.1
idea 8
clinic 8
associates 7.9
director 7.8
diverse 7.8
standing 7.8
40s 7.8
partners 7.8
test 7.7
studying 7.7
exam 7.7
employee 7.7
health 7.6
casual 7.6
workplace 7.6
ethnic 7.6
practitioner 7.6
plan 7.6
horizontal 7.5
doctor 7.5
house 7.5
friends 7.5
ideas 7.5
training 7.4
children 7.3
new 7.3
restaurant 7.2
handsome 7.1
paper 7.1
happiness 7.1

Google
created on 2022-02-26

Black 89.6
Black-and-white 87
Style 84
Art 81.4
Monochrome 79.2
Picture frame 78.9
Monochrome photography 78
Font 73
Room 70.2
Event 68.9
Rectangle 67.7
Suit 65.4
Display device 64.2
Stock photography 63.7
Visual arts 62.2
Sitting 60.3
Automotive design 60.3
Television set 58.8
White-collar worker 57.7
Photographic paper 53.2

Microsoft
created on 2022-02-26

text 85.6
person 84.1
clothing 84.1
man 63.8
black and white 59.8
human face 54.6

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 47-53
Gender Male, 64.9%
Sad 28.9%
Calm 26.3%
Happy 17.2%
Surprised 12.8%
Confused 7.7%
Disgusted 3.2%
Fear 2.7%
Angry 1.2%

AWS Rekognition

Age 38-46
Gender Female, 59.5%
Happy 27.2%
Sad 26.4%
Calm 26.1%
Confused 13.8%
Disgusted 2.7%
Angry 1.6%
Surprised 1.3%
Fear 0.9%

AWS Rekognition

Age 34-42
Gender Male, 89.1%
Calm 63.1%
Sad 25%
Confused 4.4%
Disgusted 3.8%
Happy 1.3%
Angry 1%
Fear 0.8%
Surprised 0.5%

AWS Rekognition

Age 36-44
Gender Female, 99.9%
Happy 37.7%
Surprised 29.9%
Confused 11.7%
Calm 10.1%
Sad 5.3%
Disgusted 2.8%
Angry 1.4%
Fear 1%

AWS Rekognition

Age 37-45
Gender Male, 98.7%
Calm 90.8%
Happy 8.3%
Disgusted 0.3%
Sad 0.2%
Confused 0.1%
Angry 0.1%
Surprised 0.1%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Helmet
Couch
Person 99.5%
Person 99.3%
Person 99%
Person 98.9%
Person 98.5%
Person 97.4%
Helmet 94.6%
Couch 75%

Categories

Imagga

interior objects 85.1%
food drinks 9.6%
events parties 2.1%
people portraits 1.6%

Text analysis

Amazon

5
6

Google

MJ17- -YT R2--AGO
MJ17-
-YT
R2--AGO