Human Generated Data

Title

Untitled (portrait of man and woman on couch)
Date

1962
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16898

Human Generated Data

Title

Untitled (portrait of man and woman on couch)

People

Artist: Lucian and Mary Brown, American

Date

1962

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99.5
Human 99.5
Person 98.7
Clothing 98.2
Apparel 98.2
Accessory 95
Tie 95
Accessories 95
Sitting 94.9
Chair 94.1
Furniture 94.1
Shirt 92.1
Sunglasses 85.3
Sleeve 69.4
Finger 66.3
Man 64.6
Home Decor 57.4
Couch 52.3

Imagga
created on 2022-02-26

man 56.7
male 51.1
businessman 48.6
person 42.4
office 41.1
business 40.7
executive 38.3
laptop 36.5
computer 34.6
suit 33.2
adult 33.1
people 30.1
sitting 30.1
senior 30
work 28.3
handsome 25.9
corporate 25.8
job 25.7
desk 25.5
professional 24.8
looking 24.8
working 24.8
happy 23.8
businesspeople 23.7
grandfather 23.3
portrait 23.3
manager 23.3
indoors 22
worker 21.5
success 20.9
mature 20.5
elderly 20.1
men 19.8
table 19
clothing 18.4
modern 17.5
confident 17.3
technology 17.1
glasses 16.7
occupation 16.5
happiness 16.5
indoor 16.4
one 16.4
face 16.3
formal 16.2
cheerful 15.4
old 15.3
casual 15.3
necktie 15
smile 15
bow tie 14.7
alone 14.6
businesswoman 14.5
smiling 14.5
communication 14.3
meeting 14.1
lifestyle 13.7
groom 13.6
1 13.5
boss 13.4
tie 13.3
career 13.3
expression 12.8
home 12.8
notebook 12.7
workplace 12.4
color 12.2
hand 12.2
company 12.1
successful 11.9
horizontal 11.7
mid adult 11.6
guy 11.3
garment 11.3
businessperson 10.7
bright 10.7
older 10.7
leadership 10.6
together 10.5
only 10.5
serious 10.5
couple 10.5
day 10.2
room 10
gray hair 9.9
human 9.8
seated 9.8
40s 9.7
leader 9.6
using 9.6
entrepreneur 9.6
women 9.5
one person 9.4
paper 9.4
20s 9.2
attractive 9.1
black 9
employee 8.9
jacket 8.9
60s 8.8
colleagues 8.7
conversation 8.7
concentration 8.7
corporation 8.7
retirement 8.6
sunglasses 8.6
sit 8.5
keyboard 8.5
commerce 8.4
camera 8.3
holding 8.3
secretary 8.1
planner 8
discussion 7.8
chair 7.6
relaxed 7.5
pensioner 7.4
aged 7.2
gray 7.2
team 7.2
hair 7.1
look 7

Google
created on 2022-02-26

Glasses 97.3
Tie 90
Smile 86.8
Flash photography 86.7
Black-and-white 84.4
Style 84
Eyewear 77.9
Happy 74.5
Event 73
Suit 70
Monochrome photography 69.6
Formal wear 69.5
Monochrome 69.1
White-collar worker 68
Room 65.1
Font 64.9
Conversation 64.6
Sitting 64.5
Stock photography 61.9
Fashion design 61.1

Microsoft
created on 2022-02-26

text 99.4
person 97.5
clothing 95.8
human face 93.3
man 89.6
glasses 88.1
black and white 72.5
posing 46.4

Face analysis

Amazon

Google

AWS Rekognition

Age 25-35
Gender Male, 99.8%
Calm 99.9%
Sad 0%
Confused 0%
Disgusted 0%
Angry 0%
Happy 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 27-37
Gender Male, 96%
Calm 95.9%
Surprised 1.6%
Sad 1.2%
Disgusted 0.4%
Confused 0.3%
Fear 0.3%
Happy 0.2%
Angry 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Tie 95%
Sunglasses 85.3%
Couch 52.3%

Captions

Microsoft

a man and a woman posing for a photo 82.8%
a man and woman posing for a photo 78.9%
a man and a woman posing for a picture 78.8%

Text analysis

Amazon

5
to

Google

-
MJI7--YT3RA°2 - - XAGOX
MJI7--YT3RA°2
XAGOX