Human Generated Data

Title

Untitled (family portrait in front of fireplece)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17646

Human Generated Data

Title

Untitled (family portrait in front of fireplece)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17646

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99.7
Human 99.7
Furniture 99.5
Person 99.4
Person 98.3
Person 98.2
Clothing 97.6
Apparel 97.6
Person 96
Indoors 95.8
Person 95.6
Room 94.6
Chair 91.9
Table 89.6
Interior Design 89
Home Decor 87.4
Dining Table 85.2
Face 83.5
Bedroom 74.4
Female 70.7
Shirt 70.1
Meal 69.4
Food 69.4
Portrait 63.8
Photography 63.8
Photo 63.8
Bed 63.1
Coat 61.9
Dish 61.3
Girl 61.3
Living Room 61.1
Shelf 60
Desk 59.3
Screen 57.9
Electronics 57.9
Bookcase 56.4
Flooring 55.7
Dining Room 55.4
Person 54

Clarifai
created on 2023-10-29

people 99.8
group 99.4
adult 98.6
woman 98.5
medical practitioner 96.8
man 96.7
three 95.8
monochrome 95.5
group together 95.3
four 95.2
child 94.1
five 93.4
uniform 93
several 90.5
two 90.1
facial expression 86.7
healthcare 85.6
outerwear 85.2
offspring 84.5
education 84.5

Imagga
created on 2022-02-26

clinic 44.2
man 39.7
nurse 34.7
people 34.1
adult 32.8
male 32.7
person 29.9
professional 26.2
sitting 22.3
businessman 21.2
patient 21
colleagues 20.4
room 20.4
coat 20.3
smiling 20.3
indoors 20.2
men 19.8
lab coat 19.6
medical 19.4
couple 19.2
business 18.8
happy 18.8
mature 18.6
home 18.4
indoor 18.3
businesspeople 18
businesswoman 17.3
office 16.9
hospital 16.7
20s 16.5
30s 16.4
meeting 16
computer 15.2
desk 15.1
together 14.9
table 14.7
cheerful 14.6
mid adult 14.5
women 14.2
work 14.1
doctor 14.1
senior 14.1
team 13.4
family 13.4
happiness 13.3
talking 13.3
working 13.3
worker 13.1
smile 12.8
two 12.7
interior 12.4
lifestyle 12.3
group 12.1
40s 11.7
discussion 11.7
teacher 11.6
holding 11.6
four 11.5
mother 11.2
color 11.1
health 11.1
casual 11
associates 10.8
job 10.6
pharmacist 10.5
hairdresser 10.4
portrait 10.4
occupation 10.1
clothing 10
coworkers 9.8
looking 9.6
waiter 9.6
boardroom 8.9
to 8.9
thirties 8.8
educator 8.7
standing 8.7
illness 8.6
face 8.5
health professional 8.4
laptop 8.2
kitchen 8.1
salon 8
medicine 7.9
garment 7.9
discussing 7.9
forties 7.9
day 7.9
two people 7.8
kin 7.8
sick 7.7
laboratory 7.7
modern 7.7
using 7.7
attractive 7.7
twenties 7.7
husband 7.6
teamwork 7.4
care 7.4
meal 7.4
camera 7.4
new 7.3
handsome 7.1

Google
created on 2022-02-26

Photograph 94.3
White 92.2
Table 89.8
Black 89.8
Black-and-white 85
Picture frame 84.7
Style 83.8
Smile 82.6
Hat 81.6
Cooking 76.9
Apron 76.2
Monochrome photography 75.4
Snapshot 74.3
Vintage clothing 74
Shelf 73.3
Window 73.3
Monochrome 73.2
Event 73.1
Service 70.6
T-shirt 70.5

Microsoft
created on 2022-02-26

text 99.5
indoor 93.6
clothing 89.5
table 88.8
person 87.6
man 82.8
vase 57.3
house 55.8

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 4-12
Gender Female, 77.8%
Happy 95.4%
Sad 3.4%
Calm 0.5%
Disgusted 0.2%
Angry 0.2%
Fear 0.1%
Surprised 0.1%
Confused 0.1%

AWS Rekognition

Age 30-40
Gender Male, 90.6%
Calm 96.6%
Happy 1.8%
Surprised 0.7%
Confused 0.4%
Disgusted 0.2%
Sad 0.2%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 39-47
Gender Male, 98.1%
Calm 65.5%
Happy 16.1%
Sad 8.9%
Confused 3.5%
Disgusted 2.9%
Fear 1.1%
Surprised 1%
Angry 1%

AWS Rekognition

Age 48-56
Gender Male, 94.2%
Happy 99.5%
Sad 0.2%
Surprised 0.1%
Calm 0%
Disgusted 0%
Angry 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 13-21
Gender Male, 60.5%
Happy 69.9%
Calm 27.1%
Surprised 0.8%
Sad 0.8%
Disgusted 0.5%
Confused 0.5%
Angry 0.3%
Fear 0.2%

AWS Rekognition

Age 25-35
Gender Male, 88.8%
Happy 97.3%
Sad 2.1%
Calm 0.2%
Surprised 0.2%
Fear 0.1%
Disgusted 0.1%
Angry 0.1%
Confused 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 99.7%
Person 99.4%
Person 98.3%
Person 98.2%
Person 96%
Person 95.6%
Person 54%

Categories

Imagga

people portraits 89.2%
events parties 9.1%

Text analysis

Amazon

G
MJ17--YT37A°2
KAGOK

Google

MJI7--YTRA°2
MJI7--YTRA°2